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ABSTRACT 


Unmanned systems, including unmanned combat aerial vehicles (UCAVs), are increasingly im¬ 
portant in military operations. Given the growth of unmanned systems technology worldwide, 
these systems may increasingly pose a real threat to U.S. and Allied forces in the near future. 
This thesis proposes a future concept of employing a defensive UCAV swarm, launched from 
a friendly sea-based platform. To simulate this defensive swarm system, an agent-based sim¬ 
ulation model was developed, and appropriate designs of experiments and statistical analyses 
were conducted. The investigated factors were drawn from the literature review to create sev¬ 
eral experimental designs with the objective of identifying the significant design factors of the 
Blue UCAV system. The result of the analysis shows that only five of the eleven candidate 
factors analyzed are significant, which can be used to inform the engineering specification of 
preliminary requirements for potential future development. 
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Executive Summary 


Unmanned systems, including unmanned combat aerial vehicles (UCAVs), are increasingly 
important in military operations given their versatility in mission capabilities and their ability 
to reduce risk to manned forces. However, given the growth of unmanned systems technology 
worldwide, these systems may increasingly pose a real threat to U.S. and allied forces in the 
near future. This thesis analyzes an example of such a threat: a coordinated attack by a large 
number of enemy UCAVs against a surface combatant. An example of a UCAV is the IAI 
Harop, which is an expendable UCAV designed to detect and destroy radar emissions. 

This thesis proposes a future concept of employing a defensive UCAV swarm, launched from a 
friendly sea-based platform, as a possible solution to this emerging threat. To simulate this de¬ 
fensive swarm system, an agent-based simulation model is developed, and appropriate designs 
of experiments and statistical analyses are conducted. Realistic data used to build the agent 
behaviors and characteristics in the simulation are obtained from various open sources. 

The investigated factors are drawn from the literature review to create several experimental 
designs with the objective of identifying the significant design factors of the Blue UCAV system. 
The desired outcome is the construction of a prediction model to predict the probability of 
killing an enemy UCAV, thereby providing a measure of effectiveness against the enemy UCAV 
swarm. 

The result of the analysis shows that only five of the eleven candidate factors analyzed are 
significant. Of the five significant factors, four correspond to specific controllable design factors 
of the UCAV defense system which can be used to inform the engineering specification of 
preliminary requirements for potential future development. 
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CHAPTER 1: 
Introduction 


1.1 Background 

Unmanned systems, including unmanned combat aerial vehicles (UCAVs), are increasingly 
important in military operations, given their versatility in mission capabilities and their ability 
to reduce risk to manned forces. Given the growth of technology worldwide, current and future 
adversaries may use these unmanned systems against the U.S. and/or allied nations in armed 
conflict. Furthermore, the asymmetric nature of modem warfare is exposing the effectiveness 
of high numbers and low cost UCAVs against deployed defenses. Therefore, it is necessary 
to develop a viable defensive system against this emerging threat. This thesis focuses on a 
defense system to be used against a UCAV swarm, which can be described as a large number 
of enemies or “Red” UCAVs programmed to engage a certain target, in this case a high value 
unit (HVU) deployed in open waters. The idea of a Red UCAV swarm is to saturate the anti¬ 
air (AA) defense systems of the HVU by a sustained attack. An example of such a UCAV is 
the IAI Harop, developed by Israel Aerospace Industries [1]. The IAI Harop is an expendable 
UCAV designed to detect and destroy radar emissions. This UCAV is also equipped with a 
70-pound high-explosive warhead to damage the target. According to open sources [2], this 
system has been sold to countries l ik e China, South Korea, Turkey, India and Chile 1 . Among 
possible solutions to a Red UCAV threat, one future concept is to have a defensive UCAV swarm 
to counter the saturation attack. A potential deployment approach requires that this defensive 
or “Blue” UCAV swarm system be sea based, which means that it needs to be launched from 
an HVU. Other possible solutions include improved capabilities of existing systems or future 
measures such as directed energy weapons. Investigation of such alternatives are beyond the 
scope of this thesis. 

In this thesis, the proposed approach of employing a defensive swarm of UAVs to counter the 
Red UCAV swarm threat is investigated using methods of agent-based simulation and design 
of experiments. The scenario is implemented in a freely available, open source simulation 
environment called Repast Simphony [3] which allows the user to define unique and customized 
behavior for each agent in the Java programming language. 

'Chilean involvement with the IAI Harop is limited to system evaluation only. 
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1.2 Objectives 

In this thesis, the author seeks to analyze the Blue UCAV defense system, identify the significant 
design factors, and determine the most effective ways to use them. In order to do this, the 
following objectives are proposed: 

• Define Measure of Effectiveness (MOEs) 

• Identify the behavior for each agent in the simulation 

• Build an agent-based simulation in Repast Simphony 

• Identify important design factors 

• Identify uncontrollable factors 

• Analyze the data from the simulation 

To achieve these objectives, a thorough literature review of available open and unclassified 
sources is conducted and presented in the following section to understand the nature of swarm 
UCAVs. Other material concerning unmanned aerial systems is examined as well. 

1.3 Literature Review 

Numerous research efforts on unmanned aerial vehicles (UAVs) have been conducted over the 
years. For example, Bemer [4] analyzed the effective use of multiple UAVs for the Navy’s Sur¬ 
face Search and Control, emphasizing the use of Broad Area Maritime Surveillance (BAMS) 
UAVs and Vertical Take-Off UAVs (VTUAVs). Frantz [5] described two methods of autonomous 
control of UAV swarms: the first method uses a non-linear approach to minimize the error be¬ 
tween the location of each particle and the target by accelerating particles through the search 
space until the target is found; the second method, uses a linear algorithm to determine the cor¬ 
rect heading and maneuver the swarm toward the target at a constant velocity. Another use of 
the UAVs is explained by Schaeffer [6] describing how the integration of UAVs and Shotspot- 
ter, which is an acoustic gunshot detection system, can improve the situational awareness of 
an Expeditionary Strike Group. Teng [7] described the use of two types of UAVs, a tactical 
unmanned combat aerial vehicle (UCAV) equipped with high resolution sensors and electronics 
to support ground units, which acts as a mother-ship for smaller Killer UAVs equipped with a 
specific mission-dependent sensor or warhead. 
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While the above research focuses on general UAV employment, the open literature is largely 
lacking in unclassified sources to address unmanned systems as a counter UAV system. How¬ 
ever, there are counter UAV systems, such as the ones developed by Alliant Techsystems 
(ATK) [8]. The first system consists of a projectile guided by an infrared proximity sensor that 
bursts in the vicinity of an enemy UAV and encapsulates the target with a rapidly expanding 
foam in order to disable the UAV without destroying it. This allows the possibility of recover¬ 
ing the UAV and its payload intact for intelligence purposes. The second proposed method is to 
use a directed energy weapon to shoot down the UAV. 

Another company, QinetiQ and Sula Systems [9], has designed a low-cost countermeasure to 
tactical UAVs called the Cougar Interceptor. This system is an attack UAV that targets an 
adversary UAV to cause catastrophic structural damage to it. 

The Black Dart field experimentation program [10], recognized as a venue for counter un¬ 
manned aerial vehicle experiments, is a joint agency demonstration which focuses on rapid de¬ 
velopment and implementation of counter UAV technology from readily-available commercial 
products. The organization leverages the “largest known database for sensor-weapons detection 
and response capabilities,” including “various UAV signatures, sensors and defeat mechanisms 
to assess the current range at which such UAVs can be reasonably detected and determined state 
of the art, unconventional, near-term defeat options, including directed energy options” [10]. 

The research of swarm robotics derives much of its inspiration from natural systems. Social 
insects are known to coordinate their actions to accomplish tasks that are far beyond the ca¬ 
pabilities of a single individual; termites build large and complex mounds, army ants organize 
impressive foraging raids, and teams of ants can collectively carry large prey [11]. Such coor¬ 
dination capabilities are known as swarm behavior, and there is a large body of literature de¬ 
scribing different aspects or uses of this concept. Blum [12] describes swarm intelligence as a 
modern artificial intelligence discipline that is concerned with the design of multi-agent systems 
with applications, instead of a single sophisticated controller that governs the global behavior 
of the system. The swarm intelligence principle is based on many unsophisticated entities that 
cooperate in order to exhibit a desired behavior or task, for example, to saturate the air de¬ 
fense system of a ship. Other UAV swarm studies have been conducted by the Applied Physics 
Laboratory (APL) at the Johns Hopkins University [13], such as the communication necessary 
between UAVs to take the human out of the loop in terms of individual vehicle control. Another 
example of swarm in robotics, but in a small scale, is the RoboCup competition [ 14] [ 15] [ 16], 
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which is a worldwide tournament of robots playing soccer. The objective of RoboCup is “to pro¬ 
mote robotics and AI research,” where the artificial intelligence used here could be interpreted 
as a swarm behavior to accomplish one mission, that is, to score a goal. There is also a report 
written by Sahin [11] which aims to define what swarm robotics is, and proposes different uses 
of swarm robotics in different fields. 

Swarming has been used to describe new tactics in military operations. Shannon [17] describe 
the use of swarm tactics in military operations such as the ones used on the Chechen Wars 2 
and suggest the inclusion of swarming tactics in US Marine Corps doctrine. Arquilla and Ron- 
feldt [18] describe swarming as a “deliberately structured, coordinated, strategic way to strike 
from all directions, by means of a sustainable pulsing of force and/or fire, close-in as well as 
from stand-off positions.” They also state that “developing a swarming force implies a radical 
changes in current military organizational structures, from command and control of line units 
to logistics.” This is an important point because in addition to these new tactics, it is necessary 
to develop new systems like the ones described in this thesis. 

Other studies of UAVs using agent based simulation has been performed over the years. For 
example, Ho [19] uses MANA (Map Aware Non-uniform Automata) to model ground robotics 
swarm on a search and detection mission in a semi-urban environment rigged with stationary 
improvised explosive devices. Lalis [20] use the MANA software to analyze the use of UAVs 
near Greek islands to detects illegal activities. Gill [21], uses MANA to evaluate a strike sce¬ 
nario that focuses on the coordination of the Navy Unmanned Combat Air System, the F/A-18 
Super Hornet and the F-35C Lightning II. To the best of the author’s knowledge, this thesis 
is the first work to use the Repast Simphony [3] simulation environment to simulate UAVs in 
an agent based environment. Given the open source nature of Repast, the open community 
provides ample documentation for how to implement multiple agents in three dimensional en¬ 
vironments and how to create their respective behaviors. Further, the software is freely available 
and distributable, and the developed simulation model, built in Java, can be easily and rapidly 
deployed across operating systems for broader usage. These advantages over existing propri¬ 
etary software suites lead to its use in this thesis. 


2 The First Chechen War, also known as the War in Chechnya, was a conflict between the Russian Federation 
and the Chechen Republic of Ichkeria, fought from December 1994 to August 1996. The Second Chechen War, 
a later phase better known as the War in the North Caucasus, was launched by the Russian Federation starting 
on August 26, 1999, in response to the Invasion of Dagestan by the Islamic International Peacekeeping Brigade 
(IIPB). 
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In terms of low cost UAVs, there are many open sources related to their design and control 
(see [22], [23]), where most are related to hobby radio controlled planes with some modifica¬ 
tions for unmanned flight [24]. A report from Virginia Tech in 2003 investigates the feasibility 
of a low cost expendable UAV to used for reconnaissance missions where there is chance to 
lose the platform [25]. This report concludes with an estimated cost of production for a low- 
cost UAV and explains the assumptions considered in the study. 

1.4 Scope, Limitations and Assumptions 

1.4.1 Scope 

This thesis focuses on examining the characteristics of the Blue UCAV swarm system by iden¬ 
tifying important design factors that should be taken into account in the development of such a 
future system. Based on available and unclassified information, behaviors for each Red agent 
for use in the agent-based simulation software are developed. In addition, the proposed work 
presents and implements canonical Blue agent behaviors based on notional requirements to 
best address the Red threat. Rather than defining exact engineering specifications for a defen¬ 
sive swarm system, this thesis presents how the different factors of the design space relate to 
the proposed MOE as shown by experimental design and statistical analysis. The MOEs are 
quantitative measures that give some insight into how effectively a system is performing. For 
this thesis, the MOE is how many Red UCAVs are killed by the Blue UCAV system. 

1.4.2 Limitations 

Despite the operational relevance and importance of this topic, the lack of information in the 
open domain and at the unclassified level is formidable. Therefore, in some cases the author 
uses information pertaining to analogous systems for which data are openly available. How¬ 
ever, the model and methodology presented in this thesis are designed to be flexible enough to 
accommodate more accurate and/or classified information as it becomes available. 

1.4.3 Assumptions 

For the simulation model, three types of agents are considered: 

• Blue High Value Unit (HVU) 

• Blue Unmanned Combat Aerial Vehicle (UCAV) 

• Red Unmanned Combat Aerial Vehicle (UCAV) 
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Each of the three types of agents has its own customizable behavior. Each Red agent is assumed 
to be initially airborne, i.e., it is assumed that it has already been deployed from its base, and 
that sufficient time has already passed such that the Red agent is near the operating area of the 
Blue HVU. Since the goal of this thesis research is to study the design factors relevant to the 
Blue UCAV, the Red agent behaviors are relatively constrained. Blue UCAV agents are also 
subject to limiting assumptions, such as limited endurance, i.e., a time constraint on reaching 
an incoming Red UCAV. Also, the Blue UCAV is considered to operate as a small missile (i.e., 
no sophisticated flight dynamics), and targeting of a Red UCAV is assumed perfect and self¬ 
destructive, that is, a successful kill of a Red UCAV also requires the loss of the Blue UCAV. 
The Blue HVU is operating in a given patrol area and its objective is to remain in that area. The 
Blue HVU is assumed to accurately detect and immediately assign every incoming Red UCAV 
to a Blue UCAV. In addition, agent failures (e.g., mechanical or electrical) during the mission 
are not considered. However, stochastic behavior in each simulation run is generated by using 
probabilistic parameters associated with some variables as discussed in the next chapter. 

1.4.4 Course of Study 

Figure 1.1 graphically depicts the general flow of the research performed for this thesis. First, 
a literature review is executed to gather the necessary information to build each agent behav¬ 
ior. Then, the behaviors are implemented in the agent-based simulation environment. Prior 
to executing a design of experiment, the controllable and uncontrollable factors are identified. 
The design points obtained from the design of experiments are then simulated in the simulation 
model to produce data. Finally, the data is analyzed to obtain insights of the study. 


1.5 Contribution of this thesis 

The results from this thesis can be used as a starting point in a future design of a counter UCAV 
swarm system, because this thesis focuses on some of the design factors of such a system. 

For future studies of UAV swarms, the presented model (see a screenshot from the simulation 
in Figure 1.2) can be used as a starting point for new scenarios or analyses of new factors that 
are not considered in the present study. 

This thesis also serves as a guide for the simulation of UAVs or other systems in an agent-based 
simulation [26] [27] environment besides MANA, as other tools, such as Repast Simphony [3], 
may offer additional capabilities and/or more flexibility for future studies. 
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Figure 1.1: A graphical representation of the course of study for this thesis 


1.6 Organization of the thesis 

Having presented a review of the literature above, Chapter 2 describes the general scenario as 
well as the behaviors of each agent type (i.e., Red UCAV, Blue UCAV, and Blue HVU agents). 
Then in Chapter 3, the relevant factors to be analyzed are described and a design of experiment 
proposed. Analysis addressing significant factors is performed and presented in Chapter 4, in¬ 
cluding a new design of experiment to refine a prediction model that optimizes the performance 
of the Blue UCAV system. The thesis concludes with Chapter 5, which summarizes results and 
presents recommendations and also provides avenues for future studies. 
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Figure 1.2: Screen shot of the implemented agent-based simulation model 
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CHAPTER 2: 
Model Formulation 


In this chapter, the operationally relevant context is provided as motivation for this research, and 
each agent type and behavior implemented in the developed simulation model are described. 
Further, a brief discussion on two alternative approaches initially considered is presented and 
contrasted with the agent-based simulation approach ultimately proposed by this thesis. 

2.1 Real World Scenario 

To be able to create a realistic scenario model, the author’s simulation is based on the following 
situation: 

Consider a US or allied force deployed in international open waters to patrol a 
certain region. This force is equipped with a new defense system against a UCAV 
swarm threat. The defense system consists of a large number of small UCAVs 
each equipped with an explosive warhead capable of destroying an enemy UCAV 
in flight. On the other hand, the enemy force is known to have a fleet of UCAVs 
that operates as a swarm to saturate the air defense system of an adversary’s force 
and then to engage with ballistic missiles to destroy it. The UCAV swarm can be 
deployed either from a ground based platform or sea based platform. 

Consideration must be given in the above situation to the fact that the number and characteristics 
of enemy UCAVs that make up the swarm is unknown. For the purpose of the proposed agent- 
based simulation model, the US or allied force is represented as a single high value unit (HVU), 
assumed capable of deploying the future defense system against the UCAV swarm. The scenario 
is described in Figure 2.1, where it is possible to observe that the Red UCAV agent has three 
different flight modes: Loiter, when the Red UCAV is flying at its minimum speed searching for 
a target; Approach, when the Red UCAV has detected the target and flies towards it increasing 
the speed but keeping a fixed altitude; and Attack, when the Red UCAV dives towards the target 
increasing its speed to hinder countermeasures and produce the most damage. To separate the 
three modes is important because there are different factors associated with each mode. It is 
also possible to observe that the Blue HVU is the platform where the Blue UCAVs are launched 
against the incoming Red UCAVs. 
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Scenario Set Up 




Figure 2.1: The Blue cube represent the Blue HVU patrolling in a certain area. The Blue triangles represent the 
Blue UCAV defense system. The Red spheres represent the Red UCAV swarm. 


This thesis incorporates publicly available information in an iterative fashion, such that once 
the first simulation model is constructed, a new literature review is performed to make sure that 
the simulation model reflects the real world situation. This process is repeated several times 
in order to get the final model with reasonably realistic characteristics. Figure 2.2 provides a 
diagram of the general flow of the development of this work. 


2.2 Agent Descriptions 

Based on the information gathered from the literature review and the real world scenario de¬ 
scription, each agent is described with its own behavior. To distinguish the US or allied force 
from the enemy force a color is assign to each force, i.e., Blue for the US or allied force and 
Red for the enemy. 

2.2.1 Blue High Value Unit (Blue HVU) 

The HVU is able to detect the incoming Red UCAVs and assign and launch the Blue UCAVs. 
The behavior of the HVU is simple. It needs to patrol in a certain area. However, it needs to 
detect, assign, launch, and keep track of all airborne UCAVs (Red or Blue). In Figure 2.3, it 
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Figure 2.2: This figure shows the process to obtain the final model. First, a literature review was performed in order 
to understand and define the behavior for each agent. Then, a model was implemented with the desire behavior 
for each agent. In order to verify if the model if the model does what it was design for, a second literature review 
was performed. In this case, the second literature review was focus on details such as altitude at which real UAV 
flies, check the endurance values and actual Blast ranges. When the model fits with all the requirements from the 
literature review and the desire behavior for the Blue UCAV defense system, the final model was obtained. 

is possible to see the behavior in a flow diagram. Notice that all the elements associated with 
keeping track of the information from the Red and Blue UCAVs are not explicitly identified but 
rather assumed available in real-time. At the beginning of the simulation the HVU is operating 
in a certain patrol area. Then at a certain distance it will start detecting the incoming Red UCAV. 
When the distance to the Red UCAV is less than the Launching Range , the HVU will launch 
and assign a Blue UCAV to the incoming Red UCAV. The HVU will keep track if the assigned 
Red UCAV has been destroyed or not. If one of the Red UCAV reaches the HVU, it will damage 
the HVU, and if the damage is sufficient enough to disable the HVU the simulation will end, 
and it will be assumed that the Red UCAV swarm has accomplished its mission. 

2.2.2 Blue Unmanned Combat Aerial Vehicle (Blue UCAV) 

The Blue UCAV is able to move in a three-dimensional space. Each Blue UCAV agent is 
launched upon request from the HVU. It possesses a means onboard to estimate and predict 
the position of the assigned Red UCAV, and also to measure the range to target so that the 
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Figure 2.3: This diagram have two types of blocks, the rectangles that represent actions of the HVU agent; and 
decision blocks, represented by the parallelogram 


Blue UCAV can adjust its own speed to close on the assigned Red agent and then activate the 
warhead to explode to destroy it. Each Blue UCAV launched have only one Red UCAV assigned 
to it to engage. In Figure 2.4 the behavior diagram of the Blue UCAV can be seen. After it is 
launched, the Blue UCAV needs to predict the future position of the assigned Red UCAV. This 
process is performed every time step during the simulation. Then it needs to check the distance 
to the assigned Red UCAV. If the distance to the assigned Red UCAV is within the Blast Range, 
the Blue UCAV detonates, and it have a probability of kill associated with that explosion to 
determine if the assigned Red UCAV is killed or not. 

2.2.3 Red Unmanned Combat Aerial Vehicle (Red UCAV) 

The Red UCAV is also able to move in a three-dimensional space. According to the literature 
review, an analogous operational system to the Red UCAV studied in this thesis is the IAI 
Harop, i.e., Harpy, platform, and its publicly available characteristics serve as a basis of the 
proposed behavior model. The Red UCAV will have three different modes of operation. The 
Loiter Mode, the first mode of operation, is when the Red UCAV is searching for a target, i.e., 
the HVU. During this mode, the Red agent will have a fixed altitude and will move in a certain 
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Figure 2.4: In this figure, the rectangles represent actions performed by the Blue UCAV in every time step, and the 
parallelograms represent a decision, which is like the distance sensor to activate the warhead of the Blue UCAV to 
explodes in the proximity of the assigned Red UCAV. 


loiter area defined in the scenario. The second mode is the Approach Mode, and is when the Red 
UCAV detects the HVU and approaches it, increasing its speed but keeping the same altitude. 
The last mode is the Attack Mode, when the Red UCAV reaches a certain angle between the 
vertical of the HVU and the HVU (Figure 2.5) and dives toward the HVU increasing its speed 
to perform a kamikaze type of attack. In Figure 2.6 the behavior diagram for the Red UCAV 
illustrates the transitions from one mode to another. 


2.3 Simulation Model 

Now that the behaviors of each agent have been described, it is necessary to describe the sim¬ 
ulation environment in which the agent are going to interact. As was described in Chapter 1, 
Repast Simphony is used to construct and perform the simulation. This software is a JAVA- 
based program; therefore, the behaviors described in the above sections are written in the JAVA 
language. 3 

3 The source code of the behaviors can be found in the Appendix B. 
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Figure 2.5: Angle between Red UCAV and HVU 



Figure 2.6: Red UCAV behavior diagram 
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One of the features of Repast is the possibility to create a three-dimensional space. The ori¬ 
entation of the axis coordinates as defined in the simulation can be visualized in Figure 2.7. 



The scenario built in Repast is a box of 3000 units on the X axis, 90 units on the Y axis and 
3000 units on the Z axis. For purposes of the simulation, one unit in one axis represents 100 
meters in the real world. This means that a surface of 300 km 2 and an air space of 9,000 meters 
(approximately 30,000 feet), which is the altitude of a MALE (medium altitude up to 30,000 
feet, long endurance more than 120 nm) UAV [28]. This box represents the area of patrol of the 
HVU and the airspace above it where the aerial agents (i.e., Blue and Red UCAVs) can operate. 
A special space of this box is reserved for the loiter area of the Red UCAVs. This loiter area 
is defined in the source code of the simulation, and is located as far away as possible from the 
position of the HVU within the defined box. In Repast, in order to run the simulation an internal 
clock to schedule the movement of each agent is used. This clock increases one unit or one step 
at a time. For the purpose of simulation, every time step is considered as one minute in the real 
world. 

2.3.1 Agents in the Repast Simulation Environment 

Repast uses a different Java class for defining each agent. Every agent needs at least four 
methods in the Java language to run the simulation: 

• The constructor method, where the factors are defined for each agent. 

• The step () method, where the different tasks are executed. Every task, depending on 
the agent, can have a separate method. 
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• The move () method, where the agent is told how and where to move. 

• The die () method, where the agent is removed from the simulation. 

When an agent is created in the simulated environment, the factors from each agent are ini¬ 
tialized in the constructor method. A brief definition of each factor is given below, though a 
more detailed description of these factors is given in Chapter 3. Also, any additional methods 
in support of the final agent-based simulation model are also described below. 

Blue HVU Factors and extra methods 

When the Blue HVU is created the following factors are initialized: 

px, py, pz are the position on each coordinate, py in this case will always be equal to zero. 
Speed is the speed at which the HVU moves in the patrol area. It is measured in knots. 

Energy is a variable to identify the level of damage of the HVU. 

Detection range is the distance at which the HVU detects the incoming Red UCAVs. It is 
measured in nautical miles. 

Blue per Red is the number of Blue UCAVs that are going to be launched per each incoming 
Red UCAV. It is measured in Blue UCAVs. 

Critical Red is the number of Red UCAV attacks that the HVU can receive before unable to 
perform any task, i.e., considered destroyed. It is measured in Red UCAVs. 

Red Array is an array to store the information of all the Red UCAVs. 

Distance Array is an array to store the distance from the HVU to each Red UCAV. 

Engage Array is an array to keep track of which of the Red UCAVs have been engaged. 

Kill Array is an array to keep track of which of the Red UCAVs have been killed. 

For the purposes of the simulation the detection range is also the launching range which is 
the distance at which the Blue UCAVs are launched. Note that the launching range, however, 
depends on the endurance and speed of the Blue UCAV and also the distance of the assigned 
Red UCAV. Besides the four main methods, the HVU class has methods to return the results of 


16 



the simulation, such as the number of Blue UCAVs that were launched, the number of Red hits 
to the HVU, the number of Red UCAVs that are in the area and a method to reduce energy until 
the HVU is killed by the specified number of hits by the Red UCAVs. When the HVU is killed 
or dies, the simulation will end, because this will mean that the Blue UCAV defense system has 
failed. However, the number of Red UCAVs killed before the HVU dies will be recorded and 
saved as an output of the simulation. 

Blue UCAV Factors 

These are the factors that are initialized when the HVU launches each Blue UCAV: 

px, py, pz are the positions in each coordinate. 

vx, vy, vz are the velocities in the three different axes. 

Current Red is a variable of the assigned Red UCAV to the new Blue UCAV. 

Red Point is a variable to store the position of the assigned Red UCAV. 

Blue Flag is a boolean variable to indicate if the assigned Red UCAV was killed or not. 

Blast Range is the lethal range when the Blue UCAV explodes near the Red UCAV. It is mea¬ 
sured in (fractions of) nautical miles. 

Blue Speed is the maximum speed at which the Blue UCAV flies. It is measured in knots. 

Blue Endurance is the lifetime of the Blue UCAV from being launched. It is measured in 
hours. 

When the Red UCAV is within the blast range of the Blue UCAV, there is a probability of kill 
associated with the explosion. This probability of kill is fixed in the code but can be changed 
at any time, if necessary. The value chosen for the probability of kill is 0.85 and it was se¬ 
lected based on information garnered from the literature review. Another consideration for the 
Blue UCAV is that the launching range, described in the Blue HVU, depends on the endurance 
and Blue UCAV speed and distance of the assigned Red UCAV, because if the Blue UCAV is 
launched when the Red UCAV is too far away, it may run out of fuel or battery before reaching 
its target. That is why, before the Blue UCAV is launched, the maximum range (i.e., endurance 
times Blue UCAV speed) is compared with the launching range and the distance to the assigned 
Red UCAV. 
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The method created to adjust the behavior of the Blue UCAV to reality is a noise method, that 
induces error to the true position of the Red UCAV. However, the first idea was to create a 
predictor method that would use the current position of the Red UCAV and its heading and 
speed to move the Blue UCAV to the future position of the Red. The problem with this is 
that Repast, in every time step, performs all the calculations, tasks and moves for each agent; 
therefore, the Blue UCAVs is always ahead of the Red UCAVs. For this reason, the noise 
method is used instead of the predictor method. 

Red UCAV Factors 

When the swarm of Red UCAVs is created in the simulation environment, the following factors 
are initialize: 

px, py, pz are the positions in each coordinate, 
vx, vy, vz are the velocities in the three different axes. 

Loiter Speed is the speed of the Red UCAV in Loiter Mode. It is measured in knots. 

Approach Speed is the speed of the Red UCAV in Approach Mode. It is measured in knots. 

Attack Speed is the speed of the Red UCAV in Attack Mode. It is measured in knots. 

Current Speed is a variable to keep track of the current speed during the simulation. It is 
measured in knots. 

Time is a variable to keep track of the time of the simulation. 

aAngle is the attack angle that the Red UCAV has to reach to change from Approach to Attack 
Mode. It is measured in degrees. 

Engage is a variable to set the (random) time when the Red UCAV detects the Blue HVU. It is 
measured in hours. 

From the above, it can be seen that Loiter, Approach and Attack Speed and aAngle are the same 
value for all the Red UCAVs. All the other factors are independent for every Red UCAV in the 
swarm. 
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The extra methods in the Red UCAV class are basically setters and getters, to either set a value 
or get a specific value. Transitions by the Red UCAV from Loiter to Approach modes is deter¬ 
mined by a uniform distribution, though in future work, alternative distributions may be studied. 
This distribution dictates when each Red UCAV switches modes, which is assumed identically 
and independently distributed for each agent within the simulation time window of time steps 
15 to 115. 


2.4 Development of the Model 

Several trials and runs were performed to obtain the final model. The initial model was to create 
a Red agent that flew towards the HVU agent. The second model included the Blue UCAV agent 
to finally achieve the definitive model for this thesis, which may be improved upon in a future 
study. The model development plan and work flow used over the course of this thesis is shown 
in Figure 2.8. 4 
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Figure 2.8: Model Development 


2.5 Different Modeling Approaches 

In addition to the presented agent-based simulation methods, two different approaches were 
explored in order to understand the problem using mathematical tools. However, these two 
approaches, at least at the preliminary levels at which they were studied, did not provide the 
insights that the author was seeking to determine the significant factors. 

The first approach was to analyze the scenario using combat modeling [29], specifically Lanch- 
ester Models [30]. Lanchester Models are systems of ordinary differential equations where the 
state variables represent numbers of surviving combat units. During the height of World War 

4 The final model source code can be found in the Appendix B. 


19 

























I (1916), Frederick Lanchester applied these equations to aerial combat. Two special cases of 
Lanchesters equations exist: the “square law” and the “linear law.” 


The “linear law,” also called Unaimed Fire, can be applied with the assumption that one man 
can fight exactly one other man at a time, and if identical weapons are being used, the end of 
the battle will be the difference between the larger and smaller force. The equations that model 
the “linear law” uses are the following: 

^ = B = -/ 3BR, B> 0 

at 

—— — R — —aRB, R > 0 

dt 


where 


B = ratio at which blue force decreases 
R = ratio at which red force decreases 
a = attrition coefficient at which blue kills red force 
/3 = attrition coefficient at which red kills blue force 
B = initial number of blue forces 
R = initial number of red forces 


The square law (a.k.a. Aimed Fire) represents a situation where attrition to each side is pro¬ 
portional to the number of units remaining on the other, and there are no reinforcements. The 
ordinary differential equations that model the “square law” are the following: 

^- = 3 = -PR B> 0 

dt 

^ = R = - a B R > 0 

dt 

These equations can be solved explicitly for B and R as a function of time. However, it is 
simple to eliminate time by dividing the second equation by the first where f can be 

solved as: P(R 2 — Rq) = a(B' 2 — B$). To run an analytical model, it is possible to use the 
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following formulas and obtain initial solutions for the UCAV problem, 

B(t ) = Bocosh(V^f) — Rq\ — sinh (y/a/3t) 

V CL 

R(t ) = i? 0 cosh(y/a/3t) — B 0 , — sinh(-\ /af3t) 

V r' 

where 

£>(f) = is the number of blue UCAVs at time t 
R(t) = is the number of red UCAVs at time t 
Bq = initial number of blue UCAVs at time equal zero 
Rq = initial number of red UCAVs at time equal zero 
a = attrition coefficient at which blue kills red 
/3 = attrition coefficient at which red kills blue 

Using this approach allows focus to be placed just when the Red UCAVs are in the attack mode 
and Blue UCAVs are launched against those particular Red UCAVs as described in Figure 2.9. 
Therefore, this approach only focuses on one part of the main problem and it does not deal with 
the Red UCAVs that are in the other two modes. 

The possible results that can be obtained from this approach, though, are described in Fig¬ 
ure 2.10. 

The second approach to analyze the scenario is to use a binomial modeling approach [31]. It 
can be assumed that an engagement between a Red and Blue UCAV is a binomial experiment 
for the following reasons: 

• This experiment consists of n repeated trials (each trial is an engagement). 

• Each trial can result in just two possible outcomes (Kill the Red UCAV or have the Red 
UCAV survive the engagement). 

• The trials or engagements are independent; that is, the outcome of one trial does not affect 
the outcome of other trials. 
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• The probability of success is the same in every trial or engagement. However, it will be 
assumed that the probability of success will be different for each engagement, because it 
will depend on different factors such as the mode in which the Red UCAV is flying, the 
distance at which the Blue UCAV explodes from the Red UCAV, and the accuracy of the 
Blue UCAV’s estimate of the Red UCAV position. 

Under the assumptions of a binomial experiment, an engagement between a Red and Blue 
UCAV can be defined mathematically. Better said, the probability that a Red UCAV survives a 
Blue engagement is: 


P(One Red survives) = (1 — Pm) B (2.1) 

where 


Pkiu = the probability that a Blue UCAV kills a Red UCAV 
B = the number of Blue UCAVs engaging the same Red UCAV 


The problem with this approach is a lack of the time factor, which is important for determining 
in which mode the Red UCAV is engaged. Also, it does not address other factors such as the 
launching distance and the speed of the Blue UCAV. It must be remembered that one of the 
objectives of this thesis is to identify the design factors, and Blue UCAV speed is one of them. 
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Figure 2.9: First Analysis Approach 


# of UCAVs 
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Figure 2.10: Results using first Approach, a) is the situation when the parameters are equal, B 0 = R 0 and a = 0. 
The point l at the time axis is the time it takes for one Red UCAV to reach the HVU. b) is the situation when the 
parameters are the following: B 0 > R 0 and the attrition coefficients are similar. At this point it is important to note 
this graph represent the “square law,” where the rate of change of one force is equal to the square of the opposite 
force, c) is when the initial number of Reds are greater than the initial number of Blues and the attrition coefficient 
is similar. 
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CHAPTER 3: 
Experimental Design 


In this chapter, all the factors that are involved in the simulation, including both controllable and 
uncontrollable ones and the range of relevant values to be examined are identified. Description 
of the design of experiments (DOE) methodology and the reasons for the selected approaches 
are provided. 

3.1 List of Factors 

The factors that affect the behavior and therefore the outcomes or results of the simulation can 
be divided into two groups, namely controllable and uncontrollable. The controllable factors 
are the ones related to the design of the individual Blue UCAV such as its speed, blast range, 
and endurance, which can be defined as engineering specifications. On the other hand, the 
uncontrollable factors are those for which there is not enough information or are governed by 
external factors, such as the number of incoming Red UCAVs and their respective endurance. 

3.1.1 Controllable Factors 

All these factors are related to elements which pertain to the design of the Blue UCAV system 
and the Blue HVU. All of the information described below is obtained from open sources. 

Blue UCAV speed 

This factor, for the purpose of simulation, is measured in meters per second and is a continuous 
factor. It determines how far from the HVU the Blue and Red UCAV are going to engage. 
This is relevant because one might expect that it is more likely that the Red UCAV is interdicted 
successfully by the Blue UCAV during its Approach phase rather than in the Attack phase (refer 
to the scenario model description in the previous chapter) because the Red is slower and flies 
at a fixed altitude in the Approach mode. Open sources and other available literature provide 
a wide range of speeds for the different kinds of UAVs or UCAVs, starting at 18 m/s or 35 
knots for the Wasp III [32] and reaching 0.8 Mach for the CORMORANT UAV [33]. Given 
the focus of this thesis on considering small UCAVs with limited engine size and power, the 
investigated speed range starts at 18 m/s or 35 knots and ends at 44.7 m/s or 87 knots. Figure 3.1 
provides a summary from open sources of the speed of various UAVs and UCAVs. Those in 
blue correspond to small UAVs which are relevant and analogous to the proposed system. 
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Figure 3.1: Speeds for existing UAV and UCAV systems, compiled from the open literature (see [33], [34], [35], [36], 
and [37]). The Blue blocks are the speed of the small size UAVs, and the Red blocks are the speed of the mid/large 
size UAVs. 

Preliminary investigation via a few exploratory simulation runs using speeds in the slower end 
of the proposed range shows that the the slower Blue UCAV is unable to reach and successfully 
engage the faster incoming Red UCAV (described later in this section), which is logical because 
as the Blue approaches Red, the Red UCAV uses its faster speed to leave the Blue UCAV behind. 
This fact leads to the requirement that the Blue UCAV speed be comparable to the Red approach 
speed. Therefore, the interval of the factor levels is revised to range from 45 m/s (87 knots) to 
54 m/s (105 knots). 

Blast Range 

Blast Range is the lethal range at which the Blue UCAV explodes in the proximity of the Red 
UCAV and destroys the Red UCAV. This factor depends on the amount of explosive that is 
loaded on the Blue UCAV. It is a continuous factor and is measured in meters. The purpose 
of this factor is to determine an effective Blast Range. Determining the best type of explosive 
material is beyond the scope of this research. A simple assumption is made that if the Blast 
Range increases, the payload in terms of weight of the Blue UCAV also increases. There is 
not much information available in open sources related to Blast Range pertaining to UCAV 
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applications. However, information about Anti Air (AA) missiles and their effective blast ranges 
with the respective amounts of explosive are available. In Figure 3.2 three different missiles with 
different amounts (in kilograms) of explosives and different blast ranges are shown (See [38], 
[39], and [40]). 


Ruhrstahl/KramerX-4 (1943) 


PL-5 (1990) 


Crotale NG (1990) 



■ Blast Range [m] 

■ Explosive [Kg] 


Figure 3.2: Representative anti-air missile blast range and explosive material quantity compiled from the open 
literature (See [38], [39], and [40]) 


The exemplar relationship between the amount of explosive and blast range is the one repre¬ 
sented by the AA missile PL-5, since with less explosive a bigger blast range can be achieved. 
Given that the information available is about systems from the early 1990s, it is reasonable to 
think that a larger blast range with a smaller quantity of explosive can be achieved. Conserva¬ 
tive approximation and the scope of this study lead to an assumed range of values for the Blast 
Range factor to be between 10 and 20 meters. 

Blue UCAV Endurance 

Endurance is a time measure and its units are seconds for the purpose of simulation 5 . Therefore, 
endurance can be considered as the lifetime of the Blue UCAV. It is a continuous factor and 

5 The need for resolutions on the order of seconds in simulation arises given the high speed nature (i.e., sub¬ 
minute) of the air-to-air interdiction. 
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represents the time that it takes for a Blue UCAV from its launch until it runs out of fuel or 
battery (in the case that the Blue UCAV uses an electric engine). As a reference to obtain a 
range of values, the information available from other UAV and UCAV systems is used. Similar 
to the Blast Range, an increase on Endurance is assumed to be an increase in payload weight of 
the Blue UCAV (i.e., more fuel or bigger battery). From Figure 3.3, the Endurance time from 
other UAV or UCAV systems can be seen. The endurance time of the Global Hawk is more than 
30 hours, but this is a large UAV. This study will focus on the comparable small UAVs indicated 
by blue color in Figure 3.3. 
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Figure 3.3: Endurance times for various UAVs or UCAVs systems. See [33], [34], [35], [36], [37], and [32]. The Blue 
blocks are the Endurance of the small size UVAs, and the Red blocks are the Endurance of the mid/big size UAVs. 

From Figure 3.3 it can be determined that the values for Endurance in the proposed simulation 
experiments are between 2, 000 and 4, 000 seconds or equivalently 33 to 66 minutes. 

Critical Number of Red UCAVs 

This is a continuous integer factor and reflects the maximum number of Red UCAV strikes 
that the Blue HVU is able to manage and/or withstand without the employment of the Blue 
UCAV defense system. This baseline reflects the HVU’s organic ability to destroy incom¬ 
ing Red UCAVs using Anti-Air (AA) weapons system such as the Close-In-Weapons-System 
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(CIWS) or AA missiles (or even future weapons such as directed energy), or the sum of the 
HVU speed and armor that allows the HVU to absorb a Red impact. It is assume that the lower 
limit for this factor is one if none of the HVU’s AA defenses are used (i.e., a single hit by a 
Red UCAV destroys the Blue HVU) or passive defenses (e.g., evasion speed or armor) cannot 
be improve. For the upper limit of this factor, a value of 15 assumes that the effective combined 
defense by speed, armor, and AA systems are fully maximized and utilized. 

Detection Range 

Detection Range is the distance at which the Blue HVU sensors detect the incoming Red 
UCAVs. This, too, is a continuous factor and is measured in meters. The performance of 
these sensors, such as a phased array radar used by US Navy ships are dictated by numerous 
factors, including the size of the contact. Therefore, a small target such as the Red UCAV could 
remain undetected at long distances. Considered herein is the SPY-ID(V) which is part of the 
AEGIS defense system [41], which is a phased array radar and operates in the S'-band (i.e., low 
frequency for long distance detection). Given the operational nature of the AEGIS system, un¬ 
classified information is unavailable. However, open information related to other phased array 
radar systems which also operate in the S'-band can be used, such as the Hughes Air Defense 
Radar (HADR). The HADR is able to detect aim 2 target at a range of approximately 320 kilo¬ 
meters or 172 nautical miles, which is an idea of what the detection range is going to be. The 
study assume a fix value for detection range ±5 nautical miles. This value is 320 kilometers 
or 172 nautical miles; therefore, the low value is 167 nm and the high value is 177 nm. For a 
future study, it may be of interest to include the effect of weather conditions. 

Number Of Blue UCAVs Launched Per Red 

This is a continuous integer factor, and is the number of Blue UCAVs that Blue HVU is going 
to launch when it detects one incoming Red UCAV. The reason for increasing the number of 
Blue UCAVs launched is to increase the probability of kill. However, if three Blue UCAVs for 
each incoming Red are launched and the first launched UCAV kills the Red, the other two are 
considere lost. Increasing the number of Blue UCAVs per incoming Red UCAV will nominally 
incur a storage and logistics problem onboard the HVU, but addressing this concern is beyond 
the scope of this thesis. 

3.1.2 Uncontrollable Factors 

Uncontrollable factors are those which are considered beyond the engineering design authority 
or capability of the experimenter, and in simulation are treated as noise factors. These factors 
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are related to the Red UCAV threat such as their initial numbers and their flight and attack 
characteristics. 

Red UCAV Initial Number 

Although the initial number of Red UCAVs is an input for the simulation model, in real life the 
total number of Red UCAVs would not be known. However, it is known that a UCAV swarm 
may be used as a first strike to saturate the Blue HVU defenses, e.g., anti-air defenses. Given 
the adversary’s objective, one might assume that at least the same number of AA missiles that a 
ship can carry must be launched. From open sources, it is known, for example, that the Arleigh 
Burke class destroyer has 90 vertical launcher MK 41s able to shoot 90 AA missiles in the worst 
case for a Red UCAV swarm attack. As such, the initial number of Red UCAVs is assumed to be 
any number between 50 and 100. This is a continuous integer factor measured in Red UCAVs. 

Red UCAV Dive Angle 

As described in Chapter 2 and illustrated in Figure 2.5, the Red UCAV needs to reach a certain 
angle to change from approach mode to attack mode. This angle is measured in degrees and 
starts from the vertical of the HVU to the horizon. This is a continuous factor and it can go from 
5 to 45 degrees. The impact of this change is that for a small angle (i.e., steeper dive), the Red 
UCAV stays in the approach mode longer giving the Blue UCAV more time to engage a Red 
UCAV in that mode. On the other hand, if the angle is greater (i.e., with a shallower angle of 
attack), the Red UCAV spends less time in approach mode and transition to attack mode sooner 
increasing the difficulty to engage it. 

Red UCAV Speed 

From the behavior of Red UCAV, described in Chapter 2, the Red UCAV has three different 
speeds, one for each mode. No specific publicly available data for such a multi-phase system 
is readily available. However, it is going to be assumed that the slowest speed is in the Loiter 
mode, the next faster speed in Approach mode and finally the fastest speed in the Attack mode. 
These speeds are measured in meters per second and are continuous factors. Although these 
speeds are inputs for the simulation, ranges for these three speed are define: Loiter speed 30—35 
m/s (or 58 — 68 knots), Approach speed 40—45 m/s (or 77—87 knots), and Attack speed 50 — 52 
m/s (or 97—101 knots). 

Red UCAV Endurance 

Like the Blue UCAV endurance, this is a continuous factor measured in seconds and is the time 
from when the Red UCAV is deployed from its base or launching platform until it reaches the 
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HVU or runs out of battery or fuel. However, it is known that the objective of the Red UCAV 
swarm is to saturate the HVU defenses so it tries to hit the target before it runs out of battery or 
fuel. For the simulation’s purpose, it is related to the time that the Red UCAV stays in Loiter 
mode. Available information from the IAI Harpy is used, which dictates an endurance range of 
10, 000 — 11, 000 seconds or 166 — 183 minutes. 


3.1.3 Factor Summary 

There are ten factors describe above; however, the Red UCAV Speed factor is divide into three 
and the Red UCAV Endurance is not consider as a factor because it is assume that each Red 
UCAV have sufficient endurance to reach its target (i.e., the HVU). The final list of eleven 
factors is shown in Table 3.1 with the respective ranges and units. 


CONTROLLABLE FACTORS 

FACTOR 

TYPE 

LOW VALUE 

HIGH VALUE 

UNITS 

Blue UCAV Speed 

Continuous 

87 

105 

Knots 

Blast Range 

Continuous 

10 

20 

Meters 

Blue UCAV Endurance 

Continuous 

33 

66 

Minutes 

Critical Red 

Continuous 

1 

15 

Red UCAV 

Detection Range 

Continuous 

167 

177 

Nautical Miles 

Number of Blue per Red 

Continuous 

1 

3 

Blue UCAV 


UNCONTROLLABLE FACTORS 


FACTOR 

TYPE 

LOW VALUE 

HIGH VALUE 

UNITS 

Red UCAV Initial Number 

Continuous 

50 

100 

Red UCAV 

Dive Angle 

Continuous 

5 

45 

Degree 

Red Loiter Speed 

Continuous 

58 

68 

Knots 

Red Approach Speed 

Continuous 

77 

87 

Knots 

Red Attack Speed 

Continuous 

97 

101 

Knots 

Red UCAV Endurance 

Continuous 

166 

183 

Minutes 


Table 3.1: Summary Table of Experimental Factors and Levels 

In order to create a design of experiments, it is necessary to use normalized or coded values for 
the factors. These coded values are numbers between -1 and 1. To create the coded values the 
formula below, Equation 3.1, is used [42]. 
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X 


(3.1) 


where 


^ _ {Zh+Z l ) 

(Zh-Z l ) 

2 


X = value between -1 and 1 
Z H = high value of the factor 
Z L = low value of the factor 
Z = value to code 


For example, to code the Blast Range factor with three levels (high, low and midpoint), with 
Z H = 20, Z L = 10, and Z = 10, 20, 15, the results are: 


X 

X 

X 


10 

(20+10) 

2 


(20-10) 


2 

20 

(20+10) 

2 


(20-10) 


2 

15 

(20+10) 

2 


(20-10) 

2 


10 - 15 _ -5 
5 T~ 

20 - 15 _ 5 _ 
5 “ 5 “ 

15-15 5 


So, for the three levels the results are -1,0 and 1. Now, if the number of levels is increased (A" 
can take any value between -1 and 1), then Equation 3.1 can be used and then solved for Z as 
shown in Equation 3.2. 


z = -[^(A--1)-(A- + 1)Z H| (3 2) 

With Equations 3.1 and 3.2, the factors described in Figure 3.1 are easily coded when construct¬ 
ing the experimental design matrix. This coded design is translated to actual or engineering 
units for input into the simulation model. 
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3.2 Design of Experiments 

Design of experiments is a methodology to perform experiments varying the input factor in 
a intelligent way to understand the behavior of the response variable. Montgomery defines 
an experiment “as a test or series of tests in which purposeful changes are made to the input 
variables of a process or system so that we may observe and identify the reasons for changes 
that may be observed in the output response” [42]. He also describes in his text the guidelines 
for Designing an Experiment: 

1. Recognition of and statement of the problem. This seems to be an obvious step, but 
most often it is the most important and difficult step. Without a clear understanding of 
the problem any further steps are useless. For this thesis, the problem statement was 
discussed in Chapter 2 and the objective of this thesis was described in Chapter 1. 

2. Selection of the response variable. The experimenter should be certain that the selection 
of the response variable really provides useful information about the process under study. 
In this thesis, the response variable will be the percentage of killed Red UCAVs by the 
Blue UCAV defense system. It is a number between 0 and 1. 

3. Choice of factors, levels, and range. The factors considered for the experiments are 
those that the experimenter may wish to vary in the experiment to see what happens with 
the response variable. In this thesis, the factors were described at the beginning of this 
chapter. However, the levels of each factor are defined in the choice of the experimental 
design. 

4. Choice of experimental design. In selecting the design, the experimenter should keep 
the objective of the study in mind. For this thesis, the objective is to identify the signif¬ 
icant factors that affect the percentage of Red UCAVs killed by the Blue UCAV defense 
system. First, a screening using a fractional factorial design 6 is carried out to identify 
the significant factors from the list of eleven factors described above. Then an /-optimal 
design 7 is performed to predict the percentage of kills. As a prediction model, a logistic 
regression model 8 . 

6 A fractional factorial experiment is a variation of the basic factorial design in which only a subset of the runs 
is used. A factorial design is a combination of all possible combinations of the input factors and their levels. 

7 /-optimal design is the one that minimize the value of the average prediction variance. 

X A Logistic Regression model is used for prediction of probability of occurrence of an event. With the logistic 
regression, rather than a linear regression, it is possible to ensure to predict a number between 0 and 1. 
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5. Performing the experiment. For real life experiments, it is necessary to take into account 
how to perform the experiments, because the repetition of one experiment may cause 
problems in gathering unbiased data due to the learning process from each experiment. 
For this thesis, random seeding of simulation runs ensures independent but repeatable 
trials, and bias is not relevant since there is no learning process between each experiment. 

6. Statistical Analysis of the data There are many software package designed to assist in 
data analysis, and most times simple graphical methods are very helpful to understand 
the results. For the analysis of the data of this thesis, the software JMP® 9 [43] is used 
extensively. 

7. Conclusions and recommendations. After the data have been analyzed, according to 
Montgomery, the experimenter must draw practical conclusions about the results and 
recommend a course of action. In this thesis, all conclusions and recommendations are 
discussed in Chapter 5. 

The output of the experiments, that is, the number of Red UCAVs killed by the Blue UCAVs, 
requires aggregation of data from the simulation. The simulation software makes it possible to 
obtain the number easily, but to have it be used as the response variable of interest, which is 
the percentage of Red UCAVs killed, it is necessary to divide the output number by the initial 
number of Red UCAV for that particular simulation run to get the percentage. 

3.2.1 Choice of Design 

There are eleven factors in Table 3.1. For the first screening to identify the significant factors, 
a fractional factorial design with Resolution V 9 is perform. The selection of a Resolution V 
design is because a second design, i.e., an /-optimal design, is select, and it is necessary to 
make sure that the significant factors selected are indeed the relevant factors and not the aliased 
ones. For a Resolution V design and eleven factors, it is necessary to perform 128 experiments 
or runs, and because the simulation is stochastic it is necessary to run one experiment several 
times to get an average value for that particular experiment or design point. In this thesis, each 
experiment is perform 50 times, and then the average response is calculated. Therefore, for the 
first screening experiment, 6400 simulations are perform. In Appendix A the full matrix of the 
first design with the 128 experiments can be seen. 

9 A Resolution V are designs in which no main effect or two factor interaction is aliased with any other main 
effect or two factor interaction, but two factor interactions are aliased with three factor interactions 
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For the second design, an /-optimal design is use with a logistic regression model to analyze 
the data and to be able to give practical conclusions and recommendations. The second design 
is explained in greater detail in Chapter 4 along with the analysis of the first screening. 
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CHAPTER 4: 
Analysis 


4.1 Objective of the Analysis 

The objective of this analysis is to identify the significant factors from the list of factors de¬ 
scribed in Chapter 3. The purpose of identifying the significant factors is to give insight into 
which are most relevant in the context of the future development of the Blue UCAV defense 
system. An additional goal is to seek insight into how to use the system in order to achieve a 
desired level of performance, that is, a probability of kill of the Red UCAV swarm agents. 

To achieve these objectives, two designs of experiments (DOEs) are perform. The first one is a 
screening design using a Resolution V fractional factorial design used to identify the significant 
factors. For the second DOE, an /-optimal design is used to find a prediction model to forecast 
the probability of kill of the Red UCAV swarm. 

4.1.1 Screening Design 

To perform the analysis, the statistical software JMP®9 is use. The JMP® software has several 
features and tools to help to create a DOE and perform the analysis. One of the tools used to 
perform the analysis is Fit a Model. In Figure 4.1, the setup used to perform the analysis of the 
screening design can be seen. The proposed model to be analyzed is the following: 


where 


n n n 

y — A) + PiXi + EE PijXiXj 

i =1 i= 1 j= 1 


Xj = factor values described in Chapter 2 
/3i = parameter estimates for factor main effects 
Pij = parameter estimates for two factor interactions 


(4.1) 


Note that quadratic terms are also expressed in Equation 4.1. 

jMP®’s Stepwise tool is one in which the choice of predictive factors for the proposed model 
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Figure 4.1: Snap shot of the Fit a Model screen, where the green oval shows where to put the model effects to be 
analyzed. In the presented case, a factorial to degree two is used (i.e., main effects and two factor interactions). The 
red oval is where to choose the type of analysis for the screening. The Stepwise tool is used to find the significant 
factors from the model selected in the green oval. The blue oval shows where to select the response variable, in 
this case the percentage of Red UCAVs killed. 


is carried out by an automatic procedure based on given criteria. These criteria can be selected 
in the software as shown in Figure 4.2. In this case, the selected stopping rule is Minimum 
AICc, where the Akaike information criterion (AICc) is a measure of the relative value of fit of 
a statistical model. In other words, AICc describes the tradeoff between bias and variance in 
model construction. Also, the Forward direction is select, which means that the first model to 
check is the one without variables follow by trying the variables one at the time and retaining 
the ones that are significant. 

It is necessary to mention at this point that 23 more experiments, or design points, are added to 
the initial screening design because no midpoints had been considered before. Therefore, for 
the first DOE, 151 experiments are perform with fifty replications for each design point. The 
complete design matrix with the extra 23 experiments can be found in Appendix A. 

After running the Stepwise tool, the following factors were determined to be significant factors 
by the tool: 
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Figure 4.2: Snap shot of the Stepwise screen, where the RED oval shows where to specify the criteria to select the 
significant factors. The BLUE oval is where the significant factors are selected. 


• Blue UCAV Speed 

• Blue UCAV Endurance 

• Critical Red 

• Detection Range 

• Number of Blue per Red 

• Red UCAV Initial Number 

• Red Approach Speed 

• Red Attack Speed 

• Blue UCAV Speed x Blue UCAV Endurance 

• Critical Red x Critical Red 

• Blue UCAV Speed x Detection Range 

• Blue UCAV Endurance x Detection Range 
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• Detection Range x Detection Range 

• Blue UCAV Speed x Number of Blue per Red 

• Blue UCAV Endurance x Number of Blue per Red 

• Critical Red x Number of Blue per Red 

• Number of Blue per Red x Number of Blue per Red 

• Blue UCAV Speed x Red Approach Speed 

• Blue UCAV Endurance x Red Approach Speed 

• Critical Red x Red Approach Speed 

• Red UCAV initial Number x Red Attack Speed 

With these factors a standard least square regression model 10 is create to analyze the significant 
factors. 

The model obtained from the least square regression is analyze follow the conditions list below 
of the model’s adequacy, which all pertain to the residuals, i.e., the differences between the 
predicted value and the observed value: 

1. The residuals are normally distributed 

2. The residuals have constant variance a 2 

3. The residuals are uncorrelated 

4. The residuals have a mean equal to zero 

As mentioned before, sometimes plots are good enough to explain or perform analysis. For 
example, a histogram of the residuals has enough information to check the first and fourth 
conditions, as is possible to see in Figure 4.3. 

To check the constant variance (Condition 2), it is possible to use a plot of Residual by Predicted 
shown in Figure 4.4, where one can see that the residuals have a constant variance over the Y 
axis, this means that the residuals are equally distributed above and below the mean(mean equal 
to zero) over the range of the response variable (0 and 1). 

10 The method of least squares is a standard approach to the approximate solution of over determined systems. 
“Least squares” means that the overall solution minimizes the sum of the squares of the errors made in solving 
every single equation. 
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Figure 4.3: Normality analysis, where the RED oval shows that the residuals could be distributed from a normal 
distribution (Condition 1). The BLUE oval shows that the mean of the residuals is very close to zero (Condition 4). 


Residual by Predicted Plot 
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Figure 4.4: Here it is possible to see that the residual of each prediction but two, falls within -0.2 and 0.2 (Blue lines), 
and also are equally distributed over the range of the response variable. 

To check that the residuals are uncorrelated, or there is no evidence of autocorrelation in the 
residuals, the Durbin-Watson statistic was used. This statistic is used to detect the presence of 
autocorrelation in the residuals. Frederick et al. (2001) [44] explain how to interpret and obtain 
this statistic using JMP®. When the value of this statistic is near 2.0, this implies that there 
is no autocorrelation. On the other hand, with a value near 0.0, “there is evidence of positive 
autocorrelation (high residuals tend to be followed by high residuals, and negative residuals 
tend to be followed by negative residuals).” Alternatively, a resulting value near 4.0 provides 
evidence of negative autocorrelation. In Figure 4.5, it is possible to see that the value of the 
Durbin-Watson statistic is near 2.0; therefore, there is no evidence of autocorrelation, that is, 
the residuals are uncorrelated. 

Each of the four conditions are investigate and shows to be satisfy; therefore, it is possible to 
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A ~ Durbin-Watson 

Durbin- 

Number 



Watson 

of Obs. 

Autocorrelation 

Prob<DW 

2.0881726 

151 

-0.0475 

0.4946 


Figure 4.5: The value of the Durbin-Watson statistic is near 2.0; therefore, there is no evidence of autocorrelation, 
meaning that the residuals are uncorrelated. 

say that the model obtain by the least square regression has a good fit to the data. Now it is 
necessary to check if the model is a good predictor of the data on the summary of the fit table, 
shown in Figure 4.6. In this figure, it is possible to see the RSquare and RSquare Adj values, 
corresponding to the /f-squared and adjusted //-squared values of the fit. Recall that RSquare 
provides a measure of how well future outcomes are likely to be predicted by the model. The 
range of RSquare is between zero and one, zero if the model is a bad predictor and one if the 
model is an excellent predictor; therefore, a higher value is better. The quantity, RSquare Adj, 
penalizes for adding terms that are not helpful to the model, so it is very useful in evaluating and 
comparing candidate regression models [45]. The range of RSquare Adj is also between zero 
and one, and again a higher value is better than a lower one. However, RSquare Adj is always 
less than or equal to RSquare. A good linear prediction model have similar values. In the 
case presented in this thesis, both of these values are above the 90% mark and their difference 
approximately 0.01, which is acceptable. Having checked the linear model, the significant 
factors are shown with their respective estimate values and p-value in Figure 4.7. 

4.2 /-optimal Design 

Having identify the significant factors from the previous design, an /-optimal design is perform 
in order to obtain a good prediction model. Since the response variable is a number between 
0 and 1, a variable transformation is perform.The DOE tool within JMP® is use to create the 
design with this new list of factors (both main effects and interactions), since they exhibited the 
most significant impact in the responses: 

• Blue UCAV Speed 

• Blue UCAV Endurance 

• Critical Red 

• Number of Blue per Red 

• Red Approach Speed 
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zi Summary of Fit 


RSquare 

0.938765 

RSquare Adj 

0.928797 

Root Mean Square Error 

0.083179 

Mean of Response 

0.725233 

Observations (or Sum Wgts) 

151 

AlCc BIC 


-291.567 -230.863 



Figure 4.6: This table taken from JMP, shows above a plot of the actual values by the predicted values obtained 
from the model. If the model were perfect, a line of 45 degrees will be shown instead of the disperse points. The 
summary table shows the values of RSquare and RSquare Adj, indicating how well this particular model predicts. 


The factor Detection Range, described as significant in the previous section, is not consider 
in this DOE because the launching distance of the Blue UCAV depends on the Blue UCAV 
Endurance and not on the Detection Range. Therefore, from the initial list of 11 factors, only 
the five described in the list above are vary, the rest of the factors stays at their mid values. 

This /-optimal design has 32 experiments using two (high and low) levels and the same coded 
values as the screening design. Midpoints were also included in this design. Therefore, the 
number of experiments totals 43, and again, in each experiment 50 replications are perform. 
The table of the 43 experiments can be found in Appendix A. 

To create an /-optimal design in JMP®, it is necessary to propose a model and the list of factors 
with their ranges. The proposed model is the following: 
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Parameter Estimates 





Term 

Estimate 

Std Error 

t Ratio 

Prob>|t| 

lnterce£^_ 

0.984208 

0.018763 

52.45 

<0001* 

Blue UCAV Speed 

0.1257708 

0.007295 

17.24 

<0001* 

3lue UCAV Endurance 

0.1347421 

0.007295 

18.47 

<0001* 

Critical Red 

0.1023933 

0.007295 

14.04 

<0001* 

Detection Range 

-0.045149 

0.007295 

-6.19 

<0001* 

MumberofBlue per Red 

0.1247462 

0.007295 

17.10 

<0001* 

Red UCAV Initial Number 

-0012629 

0.007295 

-1.73 

0.0858 

ped Approach Speed 

0.0358713 

0.007295 

4.92 

<.0001* 

Red Attack Speed 

0.0006077 

0.007295 

0.08 

0.9337 

3lue UCAV Speed’Blue UCAV Endurance 

-0.124055 

0.007352 

-16.87 

<0001* 

Critical Red’Critical Red 

-0.137025 

0.048499 

-2.83 

0.0055’ 

3lue UCAV Speed'Detection Range 

0.0370703 

0.007352 

5.04 

<0001* 


n IU7W7 

n nn7w 

RAT 

< nnm* 

Detection Range'Detedion Range 

-0.050225 

0.048499 

-1.04 

0.3023 

3lue UCAV Speed'Number of Blue per Red 

0.0258766 

0.007352 

3.52 

0.0006* 

3lue UCAV Endurance*Number of Blue per Red 

0.0368672 

0.007352 

5.01 

<0001* 

Critical Red*Number of Blue per Red 

-0.062045 

0.007352 

-8.44 

<0001* 

lumber of Blue per Red’Number of Blue per Red 

-0.113559 

0.048499 

-2.34 

0.0207* 

3lue UCAV Speed'Red Approach Speed 

-0.044152 

0.007352 

-6.01 

<0001* 

3lue UCAV Endurance*Red Approach Speed 

-0.04518 

0.007352 

-6.15 

<0001* 

Critical Red*Red Approach Speed 

0.0176641 

0.007352 

2.40 

0.0177* 

Red UCAV Initial Number*Red Attack SDeed 

-0.036277 

0.007352 

-4.93 

<0001* 


Figure 4.7: Parameters estimates table screen shot from JMP®. The highlighted (in red) boxes show the significant 
factors and their coefficient estimate 


5 5 5 

y = (3o + J2 + Y.Y1 ; V V '- V / ( 4 - 2 ) 

2—1 2=1 j = 1 

where 


Xi = factors listed previously 

= parameter estimates for factor main effects 
Pij = parameter estimates for two factor interactions 

Note that quadratic terms are also expressed in Equation 4.2. 

To analyze the results from these experiments, first a transformation of the response variable 
is perform using the LOGIT function. The LOGIT function is used to implement a Logistic 
Regression Model using the Generalized Logistic Model. With the Logistic Regression it is 
possible to be sure to predict a number between 0 and 1 and not a negative number or a number 
above 1, which is the case of the least square regression used in analyzing the first screening 
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DOE. The LOGIT function is the following: 



where y* and y are the transformed and original response variables, respectively. 

Second, the Stepwise tool from JMP® is use to identify significant factors from the proposed 
model using as a response variable y*. Then a normal least square regression model is create 
with the significant factors. In Figure 4.8 it is possible to see the summary of fit for this model. 


A Summary of Fit 

RSquare 

0.971399 

RSquare Adj 

0.959958 

Root Mean Square Error 

1.155873 

Mean of Response 

0.769198 

Observations (or Sum Wgts) 

43 

Figure 4.8: Summary of Fit Table for the /-optimal design 


The results from Figure 4.8 show a good predictor model based on the values of RSquare and 
RSquare Adj. However, the model violates the normality assumption of the residuals, as shown 
in Figure 4.9. The normality assumption is that the residuals can be fitted by a Normal distribu¬ 
tion. 


A ▼ Residual Column 7 

; Quantiles 

100.0% maximum 
99.5% 

97.5% 

90.0% 

75.0% quartile 
50.0% median 
25.0% quartile 
10 . 0 % 

2.5% 

0.5% 

0.0% minimum 



-3 -2-1 0 1 2 3 


- Normal(5.7e-16.0.97689) 


A Moments 


2.69177 

Mean 

2.69177 

StdDev 

2.64096 

Std Err Mean 

1.15333 

Upper 95% Mean 

0.43754 

Lower 95% Mean 

-0.1625 

N 

-0.4447 


-0.9125 


-2.7373 


-2.8049 


-2.8049 



a ▼ Fitted Normal 


5.68e-16 

0.9768914 

0.1489745 

0.3006428 

-0.300643 
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a Parameter Estimates 

Type Parameter Estimate Lower 95% Upper 95% 
Location p 5.68e-16 -0.300643 0.3006428 

Dispersion o 0.9768914 0.8054867 1.2416392 

- 2loofU kelihoofcl 1 9j1 8048442888 _ 

a Goadtfess-of-Fit Te5l 
Shapiro-Wilk WTest 

W Prob<W 

0.930953 0.0125* 


“Ho = The data is fromJJ 
p-valueS* 


Normal distribution. Small 


Figure 4.9: Normality assumption fail in /-optimal design, the Goodness of Fit test, circled with the RED oval, shows 
that the null hypotheses (the data comes from a Normal Distribution) is rejected. Therefore, the residuals fail the 
normality assumption. 


Even though the model violates the normality assumption of the residuals, the other assumptions 
still hold for this model. The mean of the residuals is nearly zero, the residuals are uncorrelated, 
and the residuals have a constant variance. This model is nevertheless use to perform predic- 


45 

























tions, knowing that the normality assumption is violate. The reason behind this decision is 
because it is known that the /-optimal design does not cover the entire design space, so maybe 
the distribution of the residuals is not completely captured by this design, despite the fact that 
the prediction parameters are acceptable. 

To perform the predictions it is necessary to transform the predicted model back to the original 
model, because now it predicts values between — oo and oo and the original model predicts 
values between zero and one. To be able to predict values between zero and one it is necessary 
to have a prediction or fitted formula as used in the following equation, which is simply the 
inverse of the LOGIT function: 


y = 


1 

^ _|_ g(—prediction formula) ’ 


(4.3) 


where the prediction formula from the transformed model is given by the following expression: 


y = 3.982 + 2.389Xi + 2.586X 2 + 0.870X 3 + 1.468X 4 
+1.998A 5 — 2.472AiA 2 — I. 902 A 1 X 5 + O. 4 IOA 2 A 4 
—2.182A 2 A 5 + 2 . 048 X 3 X 4 - I. 768 X 2 - 2.294X 3 2 , (4.4) 


where 


Xi = Blue UCAV Speed 
X 2 = Blue UCAV Endurance 
X 3 = Critical Red 
X 4 = Number of Blue per Red 
X 5 = Red Approach Speed 


In Figure 4.10 it is possible to see a plot of the predicted values versus the actual values of the 
experiments used to create the /-optimal design. 
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Figure 4.10: Fitted values vs actual values /-optimal design, which allows one to check “how well” the prediction 
model predicts the percentage of killing the Red UCAV swarm. The F-axis is the values obtained from the simulation 
and in the X-axis the values obtained from the prediction formula. If the points were aligned in a 45 degrees lines 
the predicted values will be equal to the values obtained from the simulation. 



This prediction model is test against ten experiments created using a space filling technique, 
the Latin Hypercube, in which the five significant factors are use to create ten different experi¬ 
ments with coded values between -1 and 1. These ten experiments are shown in Table 4.1. Then 
the prediction formula is use to create the prediction and then compare with the actual values 
obtained from the simulation. The result graph of the predicted values versus the real values is 
displayed in Figure 4.11. In this figure it is possible to see that there are two predicted values, 
circled with a red oval, that clearly fail the prediction. The failure of the prediction could be 
for many reasons, one of them is the small number of experiments carried out to perform the 
prediction model or the wrong choice of DOE for this data. 

Despite this possible weakness of the prediction model and with the goal of obtaining a pre¬ 
liminary intuition, a sensitivity analysis of this prediction model is perform using the Profiler 
plots in JMP®. The Profiler plots gives the analyst an idea of how a factor affects the response 
variable. In this case, five profiler plots are shown in Figure 4.12. Observe that Blue UCAV 
Speed, Number of Blue per Red, and Red Approach Speed have a linear impact over the re¬ 
sponse variable, for which, in this untransformed case, the range is between — oo and oo. Blue 
UCAV Endurance and Critical Red factors, on the other hand, have a quadratic impact on the 
response variable. This fact can also be observed in Equation 4.4, where both factors have a 
quadratic term in the prediction formula. 
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Blue UCAV 
Speed 

Blue UCAV 
Endurance 

Critical Red 

Number of Blue 
per Red 

Red 

Approach 

Speed 

0.777778 

0.111111 

-1 

0.333333 

0.333333 

- 0.11111 

1 

-0.33333 

-1 

- 0.11111 

-0.33333 

-0.77778 

-0.55556 

-0.77778 

0.777778 

0.555556 

0.555556 

0.777778 

- 0.11111 

1 

0.111111 

0.777778 

0.111111 

1 

-0.55556 

-1 

0.333333 

- 0.11111 

0.555556 

0.555556 

-0.55556 

-0.55556 

-0.77778 

0.111111 

-1 

0.333333 

-1 

0.555556 

0.777778 

0.111111 

-0.77778 

-0.33333 

1 

-0.55556 

-0.33333 

1 

- 0.11111 

0.333333 

-0.33333 

-0.77778 


Table 4.1: Latin Hypercube table 



i-1-1-1-1- 

0 0.2 0.4 0.6 0.8 1 

Column 7 


Figure 4.11: Fitted values vs actual values Latin Hypercube test. In this plot it is possible to see how the prediction 
model predicts experiments obtained from a Latin Hypercube design. The X axis represent the prediction values, 
and the Y axis represent the real values obtained from the simulation. There are two points that were predicted 
incorrectly, circled with the RED oval. 


In order to clarify and recheck the prediction model, a third experiment is perform. This time a 
space filling technique was used to create the DOE. 


4.3 Space-filling design 

The /-optimal design is not very satisfactory in order to obtain an accurate prediction model. For 
this reason a third DOE is perform using the Sphere Packing design, which is also available as a 
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Blue BlueUCAV Critical Numberof Red Approach 
UCAV Speed Endurance Red Blue per Red Speed 

Figure 4.12: Profiler plots from the /-optimal design 


tool within JMP® to create space filling designs. In this case, 22 experiments are perform using 
the full eleven initial factors. The list of experiments can be found in Appendix A. After running 
the experiments, the response variable is transform using the LOGIT function. Then using the 
Stepwise function, the significant factors are extract to construct the following prediction model 
(similar to Equation 4.2): 


n li n 

y = A) + + EE ^ x i x j 

i=l i =1 j= 1 


(4.5) 


where 

Xi = factor values described in Chapter 2 
fa = parameter estimates for factor main effects 
Pij = parameter estimates for two factor interactions 

Once the simulation experiments is conduct, a standard least square regression model is perform 
using the transformed response variable from the simulation. This model, unlike the previous 
models, satisfies all conditions, including the normality assumption of the residuals, constant 
variance, uncorrelated residuals, and a mean equal to zero. Also, the RSquare value is 1 and 
RSquare Adj is 0.999, meaning that the model predicts the data from the experiment with no 
error. This is clearly a case of an over fitted model, and it seems risky to use it as a prediction 
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model. As expected, upon checking the prediction formula, the model also unfortunately has 
the same prediction errors as did the /-optimal design. Alternative methods for conducting 
analysis, such as Gaussian Process models (see [46], [42], and [47]) can be used to analyze this 
particular set of data. However, the prediction model obtained from the Gaussian Process model 
is not easy to analyze; for example, using Excel Solver to maximize the prediction parameters 
for the probability of kill response is not straightforward. For this reason, in order to find a good 
prediction model that allows the use of the Excel Solver function (similar to the Profiler tool in 
jMP®), the three described designs are compile into a single design comprising a total of 193 
experiments. 


The resulted compiled design is a nearly orthogonal design with a maximum correlation of 
3.81% as seen in Figure 4.13. 


4 Correlations 


Blue UCAV Speed Blast Range Blue UCAV Endurance Critical Red Detection Range Number of Blue per Red Red UCAV Initial Number Dive Angle Red Loiter Speed Red Approach Speed Red Attack Speed 


Blue UCAV Speed 

1.0000 

0.0035 

-00059 

-0.0107 

-0.0129 

-0.0238 

-0.0077 

0.0026 

-0.0143 

-0.0153 

-0.0040 

Blast Range 

0.0035 

1.0000 

-0.0207 

-0.0040 

-0.0067 

0.0014 

-0.0129 

-0.0154 

-0.0009 

0.0100 

0.0068 

Blue UCAV Endurance 

-0.0059 

-0.0207 

1.0000 

-0.0018 

0.0056 

-0.0008 

0.0124 

-0.0149 

-0.0060 

-0.0023 

0.0073 

Critical Red 

-0.0107 

-0.0040 

-0.0018 

1.0000 

0.0252 

0.0173 

-0.0096 

-0.0023 

0.0041 

0.0054 

0.0127 

Detection Range 

-0.0129 

-0.0067 

0.0056 

0.0252 

1.0000 

0.0003 

0J2251 

-0.0012 

0.0117 

0.0030 

-0.0155 

Number of Blue per Red 

-0.0238 

0.0014 

-0.0008 

0.0173 

0.0003 


(4038V 

) 0.0126 

-0.0012 

-0.0018 

0.0234 

Red UCAV Initial Number 

-0.0077 

-0.0129 

0.0124 

-0.0096 

0.0051 

Qo.0381^ 


■0.0035 

0.0176 

-0.0047 

0.0047 

Dive Angle 

0.0026 

-0.0154 

-0.0149 

-0.0023 

-0.0012 


40035 

1.0000 

-0.0063 

-0.0234 

0.0034 

Red Loiter Speed 

-0.0143 

-0.0009 

-0.0060 

0.0041 

0.0117 

-0.0012 

0.0176 

-0.0063 

1.0000 

-0.0004 

0.0172 

Red Approach Speed 

-0.0153 

0.0100 

-00023 

0.0054 

0.0030 

-0.0018 

-0.0047 

-0.0234 

-0.0004 

1.0000 

0.0062 

Red Attack Speed 

-0.0040 

0.0068 

00073 

0.0127 

-0.0155 

0.0234 

0.0047 

0.0034 

0.0172 

0.0062 

1.0000 


Figure 4.13: Correlation Matrix of the Compiled design 


The same procedure outlined for the previous attempts is perform for this design. First, the 
response variable is transform using the LOGIT function. Then the Stepwise tool is use to 
identify significant factors from the proposed model, incorporating main effects, two-factor 
interactions, and quadratic terms. The resulting set of significant factors arising in this model is 
the same as those in the /-optimal design, namely Blue UCAV Speed, Blue UCAV Endurance, 
Critical Red, Number of Blue per Red, and Red Approach Speed. After that, a standard least 
square regression model is perform, and a model with RSquare of 0.799 and RSquare Adj of 
0.784 is obtain. However, the residuals obtained from this model fail the normality assumption 
(again) but satisfy the other conditions. Nevertheless, this model is used to perform the analysis 
because it shows to result in the best prediction response. 

A test of this new prediction model is perform using the same data used to test the /-optimal 
design by effectively checking the difference between the two prediction models. The graphs 
displayed in Figure 4.14 show on the left the real values from the simulation versus the pre¬ 
dicted values from the /-optimal design, and on the right graph, the same real values from the 
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simulation versus the predicted values from the compiled design. 
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Figure 4.14: The plot on the left shows the predicted values using the prediction model obtained from the /-optimal 
design, where is possible to see there are two predictions that are clearly wrong. The plot to the right shows the 
same predicted values but using the prediction model obtained from the compiled design. From these plots it is 
evident that the prediction model obtained from the compiled design is better. 


The prediction formula from this model can be described by the following equation: 

y = 3.360 + 1.136X 4 + L443X 2 + 0.878X 3 + L443X 4 
+0.428X 5 - E080X 4 X 2 + 0.353X 4 X 4 - 0.457X 4 X 5 
+0.306X 2 X 3 + 0.597X 2 X 4 - 0.554X 2 X 5 + 0.262X 3 X 4 - 1.964X 2 2 (4.6) 

where 


X 4 = Blue UCAV Speed 
X 2 = Blue UCAV Endurance 
X 3 = Critical Red 
X 4 = Number of Blue per Red 
X 5 = Red Approach Speed 


Equation 4.6 is analyze using Excel Solver to compute the optimized values for the significant 
factors in order to obtain a 99.9% of probability of kill of the Red UCAV swarm. To verify 
this prediction model, these optimized values are use as fixed inputs to the simulation model to 
compare the predicted probability with the real probability obtained from the simulation model. 
In order to obtain the simulated probability, 10 runs are perform with the optimized values. 
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Table 4.2 lists these values to obtain a predicted 99.9% probability and compares them with 
the actual values obtained from the simulation. For completeness, various levels of fidelity are 
examine. Table 4.3 shows the values to obtain a predicted 90% probability of kill, Table 4.4 
shows the value to obtain a predicted 80% probability of kill, and Table 4.5 shows the value to 
obtain a predicted 50% probability of ki ll. 


Blue UCAV 
Speed 

Blast 

Ranqe 

Blue UCAV 
Endurance 

Critical 

Red 

Detection 

Ranqe 

Number of 
Blue per Red 

Red UCAV 

Initial Number 

Dive 

Anqle 

Red Loiter 
Speed 

Red Approach 
Speed 

Red Attack 
Speed 

32.4 

0.15 

57 

15 

1720 3 

75 

25 

19.44 

26.85 

30.555 


Predicted Probability 

Simulated Probability 

99 . 9 % 

99 . 06 % 


Table 4.2: Values to obtain a predicted probability of 99.9% 


Blue UCAV 
Speed 

Blast 

Ranqe 

Blue UCAV 
Endurance 

Critical 

Red 

Detection 

Ranqe 

Number of 
Blue per Red 

Red UCAV 
Initial Number 

Dive 

Anqle 

Red Loiter 
Speed 

Red Approach 
Speed 

Red Attack 
Speed 

29.43 

0.15 

57 

9 

1720 

2 

75 

25 

19.44 

26.52 

30.555 


Predicted Probability 

Simulated Probability 

90 % 

97 . 86 % 


Table 4.3: Values to obtain a predicted probability of 90% 


Blue UCAV 
Speed 

Blast 

Ranqe 

Blue UCAV 
Endurance 

Critical 

Red 

Detection 

Ranqe 

Number of 
Blue per Red 

Red UCAV 
Initial Number 

Dive 

Anqle 

Red Loiter 
Speed 

Red Approach 
Speed 

Red Attack 
Speed 

28.93 

0.15 

59 

7 

1720 

i 

75 

25 

19.44 

26.60 

30.555 


Predicted Probability 

Simulated Probability 

80 % 

82 . 26 % 


Table 4.4: Values to obtain a predicted probability of 80% 


1 Blue UCAV 

Blast 

Blue UCAV 

Critical 

Detection 

Number of 

Red UCAV 

Dive 

Red Loiter 

Red Approach 

Red Attack! 

I Speed 

Ranqe 

Endurance 

Red 

Ranqe 

Blue per Red 

Initial Number 

Anqle 

Speed 

Speed 

Speed | 

27.84 

0.15 

66 

3 

1720 

i 

75 

25 

19.44 

26.85 

30.555 


Predicted Probability 

Simulated Probability 

50 % 

56 . 13 % 


Table 4.5: Values to obtain a predicted probability of 50% 

From Tables 4.2, 4.3, 4.4, and 4.5 one can observe that this model predicts very well the prob¬ 
ability generated by the simulation model. Therefore, Equation 4.6 serves as the selected pro¬ 
posed prediction model for further studies. 

A sensitivity analysis is conduct for this model using the Prediction Profilers from JMP®. 
In Figure 4.15, one can observe that increasing the values for all significant factors with the 
exception of Blue UCAV Endurance , the response variable will be maximized. It is possible to 
confirm this by checking the values of the significant factors in Table 4.2, where all but Blue 
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UCAV Endurance are used with its maximum value as input to the simulation model. From 
Figure 4.15, it is also possible to observe that the factor Red Approach Speed is the factor that 
least affects the response. 


A ▼ Prediction Profiler 
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Figure 4.15: Prediction Profiler of the prediction model 
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CHAPTER 5: 

Conclusions and Recommendations 


5.1 Conclusions 

The main objective of this thesis is to investigate, identify, and analyze the significant factors 
relevant to the engineering design of a Blue UCAV swarming defense system against an enemy 
Red UCAV swarm attack. Numerous models and methods for analyses are employed, including 
statistical design of experiments and applied regression modeling. 

Given the future concepts nature of this thesis and the unavailability of open technical specifica¬ 
tions for current state-of-the-art systems, this work represents the construction of a reasonable 
model based on actual data from the open source literature. Though validation is not explicitly 
performed, model verification studies ensure that the proposed model behave in the intended 
manner. In future investigations, the agent characteristics and behaviors obtained from open 
sources can be refined with more accurate or classified information. Incorporation of such 
modular updates is facilitated by the flexibility of the simulation model built in open source 
agent-based simulation software called Repast Simphony [3]. 

Statistical design of experiments is utilized to generate various inputs to the simulation model 
to elicit relationships between these inputs and the overall response, as measured by the “per¬ 
centage of Red UCAVs destroyed.” From the analysis, the following significant factors for the 
Blue UCAV defense system are identified: 


• Blue UCAV speed 

• Blue UCAV endurance 

• Critical number of Red UCAVs 

• Number of Blue UCAVs launched per Red UCAV 


The general relationships are summarized individually below. 
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Blue UCAV speed 

For Blue UCAV speed, the analysis shows that the speed of defensive assets needs to equal 
or exceed the Red UCAV approach speed to remain minimally effective. However, to obtain 
a higher probability of kill, the Blue UCAV speed is recommended to be comparable, if not 
greater than, the Red UCAV attack speed. Future studies may examine the trade offs (e.g., cost, 
payload weight, platform agility) required to enable these higher speeds. 

Blue UCAV endurance 

With respect to the Blue UCAV endurance parameter, high probability results are obtained in 
the entire range of values between 33 to 66 minutes. However, higher probability results are 
obtained at the higher level of 66 minutes for endurance. Though intuitive, this relationship may 
be further explain as follows. If the Blue UCAV is launched when the Red UCAV is still in the 
approach mode or just changing from loiter to approach mode, given its faster speed (explained 
above), the Blue UCAV have more time to intercept the Red UCAV and destroy it, whereas 
alternatively, advance deployments limit the effectiveness due to short battery life spans. 

Critical number of Red UCAVs 

This factor, Critical Red, that is, the number of direct hits the high value unit can withstand, 
is very significant in the simulation. Recall that with a Critical Red value of one, the first 
Red UCAV in the swarm to successfully reach the HVU would terminate the simulation. Yet 
information pertaining to Blue UCAVs that are previously launched though still engaging the 
target are not accounted for in the results. In real life, this might be different or might not occur. 
This is not known because in this thesis, how the Blue UCAV knows the position of the Red 
UCAV is not discussed. For example, if the information of the position of the Red UCAVs is 
given by the HVU and one Red UCAV reaches the HVU and damages the communication of 
the HVU, all the Blue UCAVs that are flying loses their targets. Therefore, Critical Red, should 
be analyzed in detail, hopefully with real or accurate data before determining the control and 
communication system of the Blue UCAV. 

Number of Blue UCAVs per Red UCAV 

The number of Blue UCAVs launched in response to each attacking Red UCAV is also a decisive 
factor. In the exploratory experiments that are perform at the end of the analysis, all experiments 
with a probability of kill above 90 percent had the high value of three for this factor, and most 
responses of probability less than 50 percent had the value of one. This improvement due to 
redundancy is, however, at the price of transport and deployment. How the Blue UCAVs are to 
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be stored in the HVU is not discussed in this thesis. It is likely to be infeasible to store 300 Blue 
UCAVs in case that 100 Red UCAVs were to attack. Prior threat intelligence of how big Red 
UCAV swarm can be is needed to best determine an appropriate number of Blue UCAVs to be 
carried by the HVU. 

Other factors 

The absence of the Blast Range factor in the set of those that are significant is a surprise for the 
author, given the thought that a larger blast range would possibly provide a tactical advantage. 
However, after the analysis and further thought, it is understandable why this factor is not 
significant. First, if the Blue UCAV is not able to reach the Red UCAV (endurance and speed), 
having a big blast range is useless. Second, given that the Blue speed was greater or equal to 
the Red approach speed (that is, it almost always reached the Red UCAV), it was a matter of 
time (endurance) to be within the Blast Range to destroy the Red UCAV. 

A number of uncontrollable factors were included in the construction and selection of the design 
of experiments. Among these factors, only the Red UCAV approach speed was determined to 
be a significant factor. The resulting conclusion is that the Blue UCAV speed must be at least 
equal to the Red UCAV approach speed in order for the defensive swarm system to be effective. 

5.2 Recommendations 

This study is a good starting point to be used as a guideline for agent-based simulation, par¬ 
ticularly one with an active and open community. Using Repast Simphony allows the user to 
simulate and visualize in a three-dimensional environment and also gives more flexibility than 
other software, such as MANA, to change the agent’s behaviors. 

Also, this study can be used for shape future designs of the Blue UCAV defense system. How¬ 
ever, more accurate information not presently available from open sources must be used. For 
these following studies, a repository containing the source code of the simulation model has 
been set up, and for tutorial purposes is also given in Appendix B, as it also provides an illus¬ 
trative example of how to implement agent-based models in Repast Simphony. These studies 
should further leverage and implement the batch processing capabilities of Repast Simphony 
when conducting simulation experiments, in order to gather the data in an automated process 
rather than running experiments individually. 

It is also recommended that further validation studies be performed on the proposed simula¬ 
tion model. Such efforts should incorporate the inclusion of more realistic platform motions, 
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including appropriate flight dynamics for both Blue and Red UCAVs. 


5.3 Follow up Studies 

The evaluation of different deployment strategies for the Blue UCAV defense system would be a 
valuable study, as it refers to how and when the Blue UCAV defense system should be launched 
and operated. For example, a question is whether it is better to launch all available Blue UCAVs 
upon first detection of the Red UCAV swarm, or to launch according the Red UCAVs’ arrival to 
within a given range? Alternatively, considering there is no endurance constraint, is it better to 
have a Blue UCAV team loiter over the HVU, waiting for the incoming Red UCAV swarm, or 
again to launch the Blue UCAVs according the the arrival of Red UCAVs. For this future study, 
it will be necessary to determine first how the Blue UCAV is going to destroy a Red UCAV, i.e., 
by impact, explosion, or other method. In contrast, if a loitering Blue UCAV team is infeasible, 
a possibility is to use another aircraft, such as the manned Hawkeye [48] (an early-warning 
Naval aircraft) or a similar unmanned aerial vehicle, as a “mother ship” to deploy the Blue 
UCAVs. Though endurance limitations are addressed, such a strategy adds a new constraint: 
how many Blue UCAVs can be carried by the mother ship? These are some of the topics that 
should be pursued to continue with this proposed future study. 

One important factor, though not considered in this thesis, is the swarming behavior of the Blue 
UCAV defense system. This refers to the ability of the Blue UCAVs to communicate when 
they are already assigned to an incoming Red UCAV to change their target assignments. For 
example, if the number of Blue UCAVs per Red UCAV is two, this means that every time that 
a Red UCAV is within range, two Blue UCAVs will be launched. Consider that one of the Blue 
UCAVs arrives first and destroys the assigned Red UCAV, leaving the other Blue UCAV idle. 
For this thesis it was assumed lost, but for a future study, this idle Blue UCAV can be reassigned 
to a different incoming Red UCAV, and instead of launching two more Blue UCAVs, perhaps 
only one additional UCAV may be launched. With this new capability of the Blue UCAV 
defense system, the number of Blue UCAVs that a Blue force should carry can be reduced. To 
accomplish this new capability, it will be necessary to use a complex control system for the Blue 
UCAV swarm, increasing its production cost. Therefore, the future analysis should also include 
the cost factor to determine the trade offs, in terms of cost-effectiveness, between a low-cost 
UCAV swarm (i.e., large number of simple UCAVs) and a high-cost UCAV swarm (i.e., reduce 
number of UCAVs but more intelligent). 

Another future study is to consider a different type of UAV, capable of carrying larger amounts 
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of explosive to produce a wider Lethal Blast Radius to destroy several incoming Red UCAVs. 
The purpose of this future study is to first determine if it is possible to produce a large lethal 
blast radius with a single UAV. Secondly, considering that all the attacking Red UCAVs are 
assumed to be seeking to engage one target, namely the HVU, even though the direction of the 
threat could be initially omnidirectional, the Red UCAVs must converge to a single position, 
the HVU. Therefore, it will be interesting to determine, based on the lethal blast radius , where 
this new type of UAV needs to be stationed to kill as many incoming Red UCAV as possible 
upon detonation. For this future study, further models of the arrival rate for the Red UCAV 
swarm and better representation of its kinematics (to predicts and estimate target positions) will 
be relevant. Figure 5.1 graphically depicts the concept for this possible future study. 




HVU 


Figure 5.1: Diagram of proposed future study. In this diagram it is possible to see the target of the Red UCAVs, the 
HVU. All the incoming Red UCAVs must to converge to this target, therefore it is possible to positioned a new type 
of UAV with a big Lethal Blast Radius to destroy the incoming Red. 
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APPENDIX A: 
Design Matrices 


A.l Screening Design Tables 

It was mentioned in Chapter 2 that the Screening design has 128 experiments plus 23 experi¬ 
ments that include midpoints. To be able to display the entire design matrix, it was separated 
into five smaller tables. All files relevant to these studies, including electronic versions, can be 
found at http : / / faculty . nps . edu/thchung under the Software section. 

A.2 /-optimal Design Tables 

This design has 43 experiments, and to able to display it was separated in two tables, one with 
22 experiments and the other with 21 experiments. The design displayed in these tables are 
those used as an input in the simulation model. To create the /-optimal design, only the signif¬ 
icant factors identified in the screening design, i.e., Blue UCAV Speed, Blue UCAV Endurance, 
Critical Red, and Red UCAV Approach Speed, were used to build the design. All the other 
factors were left with their center point values. That is why Blast Range, Detection Range, Red 
Initial Number, Dive Angle, Red Loiter Speed and Red Attack Speed have the same value in all 
the experiments. 

A.3 Sphere Packing Design Table 

This design has 22 experiments. The initial 11 factors were used to create this design. 

A.4 Latin Hypercube Design Table 

This design was created to test the prediction of the other designs. The factors used to create 
this design were the significant factors identified by the screening design. 
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APPENDIX B: 
Model Source Code 


B.l First Context Creator 

This code is used to create the space environment where the agents interact. Here it is possible 
to modify the size of the simulation space, and also to redefine the loiter area for the Red UCAV 
agents. Within the code, there are useful comments to help the reader to understand the code. 


public class firstContextCreator extends DefaultContext<Object> 
implements ContextBuilder<Object> { 

public Context build (Context<Object> context) { 

/* * * 

* Builds and returns a context. Building a context consists of 

* filling it with agents, adding projects and so forth. When this 

* is called for the master context the system will pass in a 

* created context based on information given in the model, score file. 

* When called for subcontexts , each subcontext that was added 

* when the master context was built will be passed in. 

* 

* @param context 

* @return the built context. 

*/ 

/* Define the dimensions of the air space */ 

int xdim = 3000; // The x dimension of the physical space 

int ydim = 90; // The y dimension of the physical space 

int zdim = 3000; // The z dimension of the physical space 

// Create a new 3D continuous space 

ContinuousSpaceFactoryFinder . createContinuousSpaceFactory ( null) 

. createContinuousSpace (” airspace3 D ” , context, new RandomCartesian Adder<Object > (), 
new repast . simphony . space . continuous . Sticky B orders () , xdim, ydim, zdim); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ec tion (” airspace3D ”); 

// Get the parameters p and then specify the initial numbers of 
// Red UAV and Blue HVU. 

Parameters p = RunEnvironment. getlnstance (). getParameters (); 
int numRedUAV = ( Integer )p . getValue (”initialNumberOfRedUAV” ); 
int numBlueHVU = (Integer )p . getValue (”initialNumberOfBlueHVU” ); 

//Create an array to store the information of each Red UCAV 
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redUAV [] redArray = new redUAV [numRedUAV]; 

// Populate the Red UCAV array 

for (int i = 0; i < numRedUAV; i++) { 

redUAV myRedUAV = new redUAV (); // create a new red UCAV 

context . add (myRedUAV); // add the new red UCAV to airspace 

redArray [i]= myRedUAV; 

// Move the Red UCAVs to the Loiter area 

space . moveTo(myRedUAV, RandomDraw(2800 , 3000) ,RandomDraw(80 , 90), 
RandomDraw(2800, 3 000)); 

} 

// Set the Red array in the Blue HVU class 
blueHVU. setArray(redArray); 

// Iterate over the number of BlueHVU 
for (int i = 0; i < numBlueHVU; i++) { 

blueHVU myBlueHVU = new blueHVU (); // create a new blue HVU 

context . add (myBlueHVU); // add the new blue HVU to airspace 

// Move the blue HVU to the initial position 
space . moveTo( myBlueHVU, 100,0,100); 

} 

// If running in batch mode, tell the scheduler when to end each run. 
if ( RunEnvironment. getlnstance (). isBatch()){ 

double endAt = (Double )p . getValue (” runlength ”); 

RunEnvironment. getlnstance (). endAt (endAt); 

} 

return context ; 

} 


/* * 

* Auxiliar method to get a random position for the Red UAVs 

* @param i lower limit in the axis 

* @param d upper limit in the axis 

* @ return position random number within i and d 
*/ 

private double RandomDraw( int i, int d) { 
double position ; 

position = (d—i )* Math . random () + i; 
return position ; 

} // end Auxiliar method 

} // end firstContextCreator . java 
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B.2 Blue HVU Class 


This code represents the behavior and tasks that the Blue HVU agent performs in the simulation. 
In the first part the variables are defined. Then in the constructor method, the variables are 
initialized with the information from the user panel. The other methods are used by Repast in 
order to perform the simulation. 


/* 

* Blue HVU Class 
*/ 

public class blueHVU { 


// D efi ne variables 
double px = 0.0; 
double py = 0.0; 
double pz = 0.0; 

double speed ; 


// position in x 
// position in y 
// position in z 


double range = 0; 
int myCount =0 ; 
int redHitCount = 0; 
int redKillCount = 0; 


// launching range 
// keep track of launched blue 
// keep track red HITs 
// keep track of killed reds 


int bPerR ; 


// number of blue UCAV per incoming Red 


//Create arrays to store and keep track of the data 


int 1 ; 



// 

define the 

length 

of each array. 

static 

redUAV [] redArray ; 

// 

store 

the 

id of each Red UCAV 

double 

□ 

distance Array ; 

// 

store 

the 

distance 

to each Red UCAV 

Boolean 

[] 

engageArray ; 

// 

keep 

track 

of the 

engaged Red UCAVs 

Boolean 

□ 

killArray ; 

// 

information if the 

Red UCAV was killed 


// Define agent energy 
double energy ; 


/* * 

* Constructor of the Blue HVU Agent 
*/ 

public blueHVU( ){ 

this.speed = 0.05; // Initialize initial speed 

// Get data from the user panel 

Parameters p = RunEnvironment. getlnstance (). getParameters (); 
this . 1 = (Integer )p . getValue ("initialNumberOfRedUAV” ); 
int criticalRed = (Integer)p.getValue(’’ criticalRed”); 

// Initialize initial energy 

this . energy = 10* criticalRed ; // each Red Hit is 10 units of energy, 

//define the length of each array 
this . distance Array = new double [ 1 ]; 
this . engageArray = new Boolean[l]; 
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this . killArray = new Boolean [1]; 

// Define launching range base on the Blue UCAV speed and Endurance 

double a = ( Double )p . getValue (’'blueUCAVSpeed” ); 

int b = (In te ger )p . getValue (” blueEndurance ”); 

int c = (In te ger )p . getValue (” launchingRange ”); 

if(a*b >= c){ 

this . range = (double)c; 

} 

else { 

this.range = (a*b)/2; 

} // end if the determine the launching range 
this . range =( Integer )p. getValue (’’launchingRange”); 

// Define number of Blue to launch per incoming Red 
this.bPerR = (Integer )p . getValue ( ” bluePerRed ” ); 

} // end blueHVU constructor 


/* * 

* Populate Red Array 
*/ 

public static void set Array (redUAV [] x){ 
redArray = x; 

} 


// Schedule the step method for agents. The method is scheduled starting at 

// tick one with an interval of 1 tick. Specifically , the step starts at 1, and 

// and recurs at 2,3,4,...etc 
@ScheduledMethod( start = 1, interval = 1) 
public void step () { 

//Get the context in which the blue HVU resides. 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ection (” airspace3D ” ) 
double heading = RandomDraw(0 ,2* Math . PI); 

// Get position of the Blue HVU agent and its coordinates on the 3D space to 
// give it to the new blue UAV 

NdPoint blueHVUpoint = space . getLocation (this ); 
px = blueHVUpoint. getX (); 
py = blueHVUpoint. getY (); 
pz = blueHVUpoint. getZ (); 

//Populate the information Arrays 
NdPoint redPoint = null ; 
for(int m= 0; m < 1; m++){ 
if ( engageArray [m] != null){ 

// do not update 

} 

else { 

redPoint = space . getLocation ( redArray [m]); 

double distBetweenUAV = space . getDi stance ( blueHVUpoint , redPoint); 
distance Array [m]= distBetweenUAV ; 
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} 

killArray [m] = red Array [m]. getB lueFlag (); 
} // end for 


// check distance and create a blue UAV to engage incoming RED UAV 

for (int i = 0; i<l ; i++){ 

if ( kill Array [ i ] == true && redArray [ i ]. getPrint () == true){ 

// System . out. p rin tin (”Red #: ” + i + ” has been kill”); 
redArray [ i ]. setPrint (); 
redKillCount ++; 

} // end if ( kill Array [ i ] == true && redArray [ i ]. getPrint () == true) 
if ( distance Array [ i ] <= range && engageArray [ i ] == null){ 
engage Array [ i ]= true; 

//System . out. p rintln (” LAUNCHING to RED #: ”+ i); 
for (int q = 0; q < bPerR; q++){ 

// Run Environment. getlnstance ( ). wait (1); 

blueUAV myblue = new blueUAV ((redUAV) red Array [ i ]); 

context . add (myblue ); 

space . moveTo (myblue , px , py , pz ); 

} // end for (int q = 0; q < bPerR; q + +) 
myCount++; 

} // end if ( distanc e Array [ i ] <= range && engageArray [ i ] == null) 

} // end for 

// End Simulation if Number of Red UAV is 0 
if (numRedUAVQ == 0){ 

System . out . println (” Results : Red Killed by Blue: ” + redKillCount + 
” ; Red HITS: ” + redHitCount ); 

RunEnvironment. getlnstance (). endRun (); 

} 

//Move the HVU 
move( heading ); 

// End Simulation if Number of Red UAV is 0 
if (getEnergy () <= 0 ){ 
die (); 

System . out . println (” Results : Red Killed by Blue: ” + redKillCount + 
” ; Red HITS: ” + redHitCount); 

RunEnvironment. getlnstance (). endRun (); 

} // end if (getEnergy () <= 0 ) 

} // end step () method 


/* * 

* Method to move the Blue HVU Agent using as an input the heading 
*/ 

public void move(double heading) { 

//Get the context in which the RedUAV resides. 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ection (” airspace3D ” ) 
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//Move the agent by vector 

space . moveBy Vector (this , speed ,0 ,heading ,0); 

} // end move () method 

/* * 

* Public getter for the data gatherer for counting 
*/ 

public int isBlueHVUQ { 
return 1; 

} 

/* * 

* Auxiliar method to get a random number between two numbers 

* @param i 

* @param d 

* @return 
*/ 

public double RandomDraw( int i, double d) { 

double ranNum = (d—i )* Math . random ()+ i ; 
return ranNum; 

} 

/* * 

* Getter method for the HVU energy 
*/ 

public double getEnergy(){ 
return energy; 

} 

/* * 

* Method to produce a Red UCAV Hit. It will decrease the HVU energy by 10 units 
*/ 

public void hit(redUAV r){ 
int damage = 10; 
int red=0; 

energy = energy—damage ; 
for (int m=0;m<l ;m++){ 

if ( redArray [m]== r ){ 
red =m; 

} // end if 
}// end for 
redHitCount ++; 

} 

/* * 

* Method to kill the HVU agent 
*/ 

private void die () { 

Context context = ContextUtils . getContext ( this ); 
context . remove (this ); 

} 
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/* * * 

* Method to count the number of flying Red UCAVs 
*/ 

public i n t numRedUAV () { 

Context context = ContextUtils . getContext ( this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ection (” airspace3D ”); 
Iterator list = space . getObjects (). iterator (); 

Object o = null; 
int nRuav = 0; 
while ( 1 i s t . hasNext ()) { 
o = list.next(); 
if ( o instanceof redUAV) { 
nRuav +=1; 

} // end if 
}// end while, has 
return nRuav; 

} 

// Getters to gather data 

public int getMyCount (){ return myCount;} 

public int getRedHitCount (){ return redHitCount;} 

public int getRedKillCount (){ return redKillCount ;} 

} // end class redUAV 


B.3 Blue UCAV Class 

This code represents the behavior of the Blue UCAV agent. As in the Blue HVU class definition, 
first the variables are defined, and then in the constructor method, the variables are initialized. 
After that, Repast uses the other methods to perform the simulation. 

@AgentAnnot( displayName = ’’Agent”) 

/* * 

* Blue UCAV Class 
*/ 

public class blueUAV { 

double px = 0.0; 
double py = 0.0; 
double pz = 0.0; 

double vx = 0.0; 
double vy = 0.0; 
double vz = 0.0; 

double speed = 0.0; 
int endurance; 
int lifeTime = 0; 


// 

position 

in 

X 


// 

position 

in 

y 


// 

position 

in 

z 


// 

velocity 

in 

x- 

-direction 

// 

velocity 

in 

y- 

-direction 

// 

velocity 

in 

z- 

-direction 

// 

speed of 

th 

e 

Blue UAV 

// 

blue UCAV e 

nd 

urance 

// 

keep trac 

k 

Of 

the time 
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double 

redX = 

0.0; 

// 

X coordinate 

of the 

red 

UAV 

double 

redY = 

0.0; 

// 

Y coordinate 

of the 

red 

UAV 

double 

redZ = 

0.0; 

// 

Z coordinate 

of the 

red 

UAV 

redUAV 

current 


// 

Determine the 

Red UCAV 

to engage by the Blue UAV 


NdPoint redPoint = new NdPoint (redX , redY , redZ); // Position of the red UAV 

double energy = 100.0; // Define agent energy 

double blastRadius ; // blast radius of the blue UCAV 


/* * 

* Constructor of the Blue UCAV Agent. As an input uses the assigned Red UCAV 

* @param rUAV 
*/ 

public blueUAV(redUAV rUAV){ 

// Get values from user panel and initialize variables 

Parameters p = RunEnvironment. getlnstance (). getParameters (); 

this . speed = (Double ) p . get Value (’’blueUCAVSpeed” ); 

this . endurance = (Integer )p . getValue (”blueEndurance” ); 

this . blastRadius = ( Double )p . getValue (” blastRadius ”); 

this . current = rUAV; // set the assigned Red UCAV 

} 

/* * 

* Schedule the step method for agents. The method is scheduled starting at 

* tick one with an interval of 1 tick. Specifically , the step starts at 1, and 

* and recurs at 2,3,4,...etc 
*/ 

@ScheduledMethod( start = 1, interval = 1) 
public void step () { 
lifeTime + + ; 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ection (” airspace3D ”); 

// Get the position of the Blue UCAV agent and its coordinates on the 3D space 
NdPoint blueUAVpoint = space . getLocation (this ); 

px = blueUAVpoint. getX (); // The x coordinate on the 3D continuous space 

py = blueUAVpoint. getY (); // The y coordinate on the 3D continuous space 

pz = blueUAVpoint. getZ (); // The z coordinate on the 3D continuous space 

// define a boolean local variable to help to print the data 

boolean killed = false ; 

// Check the energy if equal to zero if the Blue UCAV die because explodes 
if ( current . getEnergy() = = 0){ 
this.die (); 
killed = true ; 

return; // exit this method 

} // end if ( current. getEnergy () = = 0) 
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// Check if the Blue UCAV is still flying 
if ( current . getEnergy () != 0){ 

// Get the position of the assigned Red UCAV 
redPoint = space . getLocation ( current ); 

// Check Real Distance between the UCAVs and set the blue UCAV 
// energy to zero if it misses 

double distToUAV = 100; // initialize local variable 

if (redPoint==null){ // check if the assigned Red UCAV is dead. 

return; // exit the method 
} // end if ( redPoint--null) 

// update real distance between UCAVs 

distToUAV = space . getDi stance ( blueUAVpoint , redPoint); 

// Using the initial position of the assigned Red UCAV add some 

// noise to used as predicted position 

redX = redPoint . getX ()+ noise (); 

redY = redPoint . getY ()+ noise(); 

redZ = redPoint . getZ ()+ noise(); 

// Define a local variable to adjust speed of the Blue UCAV. 
double dist = space . getDistance (blueUAVpoint , redPoint); 
if(dis t <= speed){ 

speed = dist ; // adjust Blue UCAV Speed 

} // end if (dist <= speed) 

// update the velocity in the 3 coordinates of the blue UCAV 
vx = (px—redX )/dist ; 
vz = (pz—redZ )/dist ; 
vy = (py—redY )/dist ; 


//move the blue UCAV to the predicted position of the Red UCAV 
move (); 

} // end if (current. getEnergy() != 0) 

// create a local variable to help to gather the data 

boolean myCatch = false ; 

// kill the Blue UCAV if its energy is equal to zero 
i f ( current . getEnergy () == 0 && killed == false){ 
this.die (); 
myCatch = true ; 

} // end if (current. getEnergy () == 0 && killed == false) 

// Check distance to kill the assigned Red UCAV 
if (current . getEnergy () != 0 && killed == false){ 

double rangeToTarget = space . getDistance ( space . getLocation (this ) , 

space . getLocation ( current) ); 

// if the distance between UCAVs is less than the Blast Radius. 
if (rangeToTarget <= blastRadius ){ 

this, die (); // Blue UCAV explodes 

myCatch - true ; 

// Probability that the Red UCAV die with the explosion 
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if (Math . random () <= .85){ 

current . die (); // kill the Red UCAV 

current . setBlueFlag (); // Inform to the HVU 

} // end if (Math. random () <= .85) 

} // end if (rangeToTarget <= hlastRadius ) 

} // end if (current. getEnergy () /= 0 && killed == false) 

// kill the agent if its energy is equal to zero or lifetime 
if(myCatch == false &&(energy == 0 || lifeTime >= endurance))! 

this, die (); //kill the Blue UCAV 

} // end if(myCatch == false &&(energy == 0 || lifeTime >= endurance)) 

}// end step method 


/* * 

* This method is used to move the Blue UCAV agent 
*/ 

public void move() { 

//Get the context in which the blueUAV resides. 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProj ection (” airspace3D ” ) 
// Move by vector 

space . mo veBy Displacement (this, — vx*speed, — vy*speed,— vz*speed); 

} // end move () method 
/* * 

* Method to kill an Agent 
*/ 

private void die () { 

Context context = ContextUtils . getContext (this ); 
context . remove (this ); 

} // end die 

/* * 

* Method to decrease the energy of the Agent 
*/ 

private double setEnergy (double i) { 
return energy = i; 

} // end setEnergy 

/* * 

* Method to create the noise to the Red UCAV position 

* @return a number between 0 and 1/10000. 

*/ 

private double noise(){ 

double noise = Math . random ()/1 0000; 
return noise; 

} // end noise 
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/* * 

* Public getter for the data gatherer for counting 

* @return 
*/ 

public int isBlueUAVQ { 

return 1; 

} // end isBlueUAV 
}// end Blue UCAV class 


B.4 Red UCAV Class 

This is the code that defines the model of the Red UCAV agent behavior. Again, similar to the 
Blue HVU and Blue UCAV classes, first the variables are defined and then in the constructor 
method the variables are initialized. Repast uses the other methods described in this code to 
perform the simulation. 

@AgentAnnot( displayName = ” Agent”) 


/* * 
* 


* Red 

UCAV cl a 

ss 







*/ 









tublic 

class redUAV { 








double 

px = 0 

0; 

// 

position 

in x 




double 

py = 0 

0; 

// 

position 

in y 




double 

pz = 0 

0; 

// 

position 

in z 




double 

vx = 0 
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// 

velocity 

in x—di 
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double 

vy = 0 
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// 

velocity 
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double 

vz = 0 
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// 

velocity 
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rection 



double 

loiterS 

peed ; 

// 

loiter speed of 

the red 

UCAV 


double 

approac 

hSpeed; 

// 

approach 

speed of the re 

d UCAV 


double 

attackSpeed ; 

// 

attack speed of 

the red 

UCAV 


double 

current 

Speed; 

// 

speed to 

keep be 

used on 

the simulat 


double 

energy 

= 100.0; 

// 

D efi ne 

gent ene 

rgy 



double 

time ; 


// 

time cou 

nt to en 

gage [s] 



double 

aAngle 


// 

Attack a 

ngle of 

the Red 

UAV Swarm 


double 

engage 


// 

Engagement time 




blueHVU 

hvu ; 


// 

get the 

value of 

the age 

nt HVU 


Boolean 
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ag = false; 

// 
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the data in 


Boolean 

print 

= true ; 

// 

boolean 
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/* * 

* Constructor of the Red UCAV agent 
*/ 

public redUAV(){ 

// Get values from user panel and initialize variables 

Parameters p = RunEnvironment. getlnstance (). getParameters (); 

this . aAngle = ( Double ) p . getValue (” dive Angle ”); 

this . loiterSpeed = ( Double )p . getValue (” loiterSpeed ”); 

this . approachSpeed = (Double )p . getValue (” approachSpeed”); 

this . attackSpeed = ( Double )p . getValue (” attackSpeed” ); 

this . currentSpeed = loiterSpeed; // set current speed to loiter speed 

this . engage = RandomDraw (); // initialize the engagement time 

} // end redUAV constructor 

//Schedule the step method for agents. The method is scheduled starting at 
// tick one with an interval of 1 tick. Specifically , the step starts at 1, and 
// and recurs at 2,3,4,...etc 
@ScheduledMethod( start = 1, interval = 1) 
public void step () { 

//Get the context in which the RedUAV resides. 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProjection (” airspace3D” ) ; 

// Set random movement for the red UAV in Loiter Mode 
vx = RandomDraw ( — 1 ,1); 
vy = 0; 

vz = RandomDraw ( — 1 ,1); 

// Initialize distance variables 
double distToHVU=2; 
double distToUAV=2; 

// get the simulation time 

time = RunEnvironment. getlnstance (). getCurrentSchedule (). getTickCount (); 

// Check if engage or not (change from Loiter to Approach mode) 

// if the simulation time is greater to the engage time of each agent then ENGAGE 
if (time > engage){ 

// Increase speed to Approach mode speed 
currentSpeed = approachSpeed; 

// Get the Red UCAV Coordinates from the space 
NdPoint point = space . getLocation (this ); 

px = point . getX (); // The x coordinate on the 3D continuous space 

py = point . getY (); // The y coordinate on the 3D continuous space 

pz = point . getZ (); // The z coordinate on the 3D continuous space 

//Find the position of the Blue HVU 
Iterator list = space . getObj ects (). i t e r a t o r (); 

Object o = null; 

NdPoint bluePoint = null ; 
while ( list . hasNext ()) { 
o = list.next(); 
if ( o instanceof blueHVU ) { 
hvu = (blueHVU) o; 

bluePoint = space . getLocation ( o ); 
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}// end if for BlueHVU 
} // end while 

// check if the HVU has been destroy 
if (hvu . getEnergy() = = 0){ 

return; // exit the method 

} //end if HVU is destroy 

// Calculate the Red UCAV velocity vector 
distToHVU = space . getDistance ( point , bluePoint); 
vx = (px—bluePoint . getX ())/distToHVU ; 
vz = (pz—bluePoint . getZ ())/distToHVU ; 

vy = 0; // in approach mode, the Red UCAV have a fixed altitude 

// if the angle is equal or less than aAngle dive into blue HVU 
// (change from approach to attack mode) 

if (Math .cos (Math . toRadians( aAngle )) <= (py—bluePoint . getY ()) / distToHVU){ 
vy = (py— bluePoint . getY ())/distToHVU ; 

//Increase speed to attack mode speed 
currentSpeed = attackSpeed ; 

} // end if dive into blueHVU 

}// end if engage 

//adjust the speed to hit the HVU 
if (distToHVU <= currentSpeed){ 

currentSpeed = distToHVU; 

} 

//Move the RedUAV 
move (); 

//check distance to HVU 
if (distToHVU <= 0.01){ 

setEnergy (0); // Red UCAV reach the HVU 

hvu . hit (this ); // hit the HVU 

} //end if (distToHVU <= 0.01) 

// kill the agent 
if (energy <=0){ 
die (); 

} // end if ( energy <=0) 


} // end step () method 


/* * 

* Method to move the Red UCAV agent 
*/ 

public void move() { 

//Get the context in which the RedUAV resides. 

Context context = ContextUtils . getContext (this ); 

ContinuousSpace space = ( ContinuousSpace ) context . getProjection (” airspace3D” ); 
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// Move by Displacement 

space . mo veBy Displacement (this , — vx*currentSpeed , — vy*currentSpeed , — vz*currentSpeed ) 
} // end move () method 


/* * 

* Public getter for the data gatherer for counting 

* @return 
*/ 

public int isRedUAVQ { 

return 1; 

} // end isRedUAV 


/* * 

* Auxiliar method to get a random number between 

* @ par am i 

* @param d 

* @return 
*/ 

private double RandomDraw( int i, double d) { 
double ranNum = (d—i )*Math . random ()+ i ; 
return ranNum; 

} // end RandomDraw 


two numbers 


/* * 

* Auxiliar method to get a random number according certain distribution 

* @return 
*/ 

private double RandomDraw () { 

double engage = Math . random()* 100 +15; 
return engage ; 

} // end RandomDraw 

/* * 

* Setter method for Energy 
*/ 

public double setEnergy ( double i) { 
return energy = i; 

} 

/* * 

* Getter method for Energy 
*/ 

public double getEnergy(){ 
return energy; 

} 

/* * 

* Method to kill the Red UCAV Agent 
*/ 

public void die () { 

Context context = ContextUtils . getContext ( this ); 
context . remove (this ); 


88 



* Getter method for Red UCAV Speed 
*/ 

public double getSpeed(){ 
return currentSpeed; 

} 

/* * 

* Getter method for Red UCAV x vector velocity 
*/ 

public double getXvel(){ 
return vx; 


* Getter method for Red UCAV y vector velocity 
*/ 

public double getYvel(){ 

return vy; 

} 

/* * 

* Getter method for Red UCAV z vector velocity 
*/ 

public double getZvel(){ 
return vz ; 


* Setter method for Blue flag to gather data in the HVU agent 
*/ 

public Boolean setBlueFlag (){ 
blueFlag = true; 
return blueFlag; 

} 

/* * 

* Getter method for Blue flag to gather data in the HVU agent 
*/ 

public Boolean getBlueFlag (){ 
return blueFlag; 

} 

/* * 

* Getter method to gather data in the HVU agent 
*/ 

public Boolean getPrint(){ 
return print; 

} 

/* * 

* Setter method to gather data in the HVU agent 


public void setPrint(){ 
print = false ; 

} 

} // end class redUAV 
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